-- Logs begin at Fri 2022-06-24 02:19:11 UTC, end at Fri 2022-06-24 04:36:56 UTC. -- Jun 24 04:08:33.022288 dv-cinder-846842-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 04:08:33.032277 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 04:08:33 2022] *** Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: nodename: dv-cinder-846842-3-iscsi Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: machine: x86_64 Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: clock source: unix Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: pcre jit disabled Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: detected number of CPU cores: 4 Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: current working directory: / Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: detected binary path: /usr/bin/uwsgi-core Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: your processes number limit is 47680 Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: your memory page size is 4096 bytes Jun 24 04:08:33.034004 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: detected max file descriptor number: 2048 Jun 24 04:08:33.034846 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: lock engine: pthread robust mutexes Jun 24 04:08:33.034846 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: thunder lock: enabled Jun 24 04:08:33.034846 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 04:08:33.034846 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 04:08:33.079827 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: Python main interpreter initialized at 0x5654abc279c0 Jun 24 04:08:33.079827 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: python threads support enabled Jun 24 04:08:33.079827 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: your server socket listen backlog is limited to 100 connections Jun 24 04:08:33.079827 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: your mercy for graceful operations on workers is 90 seconds Jun 24 04:08:33.080179 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 04:08:33.080257 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: *** Operational MODE: preforking *** Jun 24 04:08:33.080489 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: *** uWSGI is running in multiple interpreter mode *** Jun 24 04:08:33.080489 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: spawned uWSGI master process (pid: 103843) Jun 24 04:08:33.080677 dv-cinder-846842-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 04:08:33.081309 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: spawned uWSGI worker 1 (pid: 103844, cores: 1) Jun 24 04:08:33.081577 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: spawned uWSGI worker 2 (pid: 103845, cores: 1) Jun 24 04:08:33.081735 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 04:08:33.740913 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 04:08:33.751948 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 04:08:34.875160 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:08:34.875160 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: from cryptography.utils import int_from_bytes Jun 24 04:08:34.875773 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:08:34.875773 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: from cryptography.utils import int_from_bytes Jun 24 04:08:34.880097 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:08:34.880097 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: from cryptography.utils import int_from_bytes Jun 24 04:08:34.880555 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:08:34.880555 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: from cryptography.utils import int_from_bytes Jun 24 04:08:37.366358 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 04:08:37.366945 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 04:08:37.367091 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 04:08:37.367453 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 04:08:37.367711 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 04:08:37.368100 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.368425 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.368747 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.369068 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.369399 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.370260 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.370611 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.370935 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.371265 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.371528 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.371696 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 04:08:37.372080 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.372170 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 04:08:37.372265 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-3-iscsi {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.372462 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.372548 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 04:08:37.372767 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.372853 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 04:08:37.373060 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 04:08:37.373155 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.373386 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.373472 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.373693 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374048 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374268 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374364 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374602 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374701 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.374949 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375103 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375257 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375550 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375682 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375858 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.375980 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376169 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376284 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376431 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376577 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376743 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.376848 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377064 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-3-iscsi {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377162 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377384 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377470 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377686 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377774 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.377992 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378080 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378304 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378427 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378630 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378717 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-3-iscsi {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.378949 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.379089 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.379252 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.379392 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.379637 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.379752 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380049 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380144 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380347 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380441 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380653 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380739 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.380971 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381075 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381278 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381376 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381583 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381712 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381898 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.381984 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382201 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382326 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382548 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382643 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382856 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.382954 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383167 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383253 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-3-iscsi {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383477 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383564 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383786 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.383874 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384105 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384206 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384410 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384522 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384715 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384832 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.384968 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.385140 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.385870 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.386203 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.386603 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.386707 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.386938 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387048 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387203 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387291 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387458 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387577 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387779 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.387901 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388101 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388221 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388412 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388542 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388713 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.388847 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389014 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389152 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389320 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389457 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389774 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.389933 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390077 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390240 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390395 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390577 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390673 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390898 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.390990 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391212 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391305 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391535 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391623 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391844 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.391930 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392091 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392187 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392338 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392547 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392800 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.392972 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393114 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393452 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393579 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393774 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.393873 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394085 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394172 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394426 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394529 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394752 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.394853 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395061 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395148 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395358 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395452 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395662 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395760 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.395966 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396052 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396283 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396377 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396587 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396684 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396836 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.396944 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397141 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397283 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397441 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397530 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397760 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.397846 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398064 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398157 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398422 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398514 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398697 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398784 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.398996 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399095 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399301 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399389 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399605 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399692 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.399909 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400005 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400214 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400302 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400519 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400614 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400824 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.400921 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.401237 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.401685 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.401780 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.401946 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402033 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402248 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402344 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402578 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402669 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.402985 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403201 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403296 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403504 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403591 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403808 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.403897 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404106 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404195 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404408 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404501 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404711 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.404797 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405012 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405100 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405314 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405401 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405616 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405702 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.405916 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406004 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406305 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406550 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406672 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406853 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.406961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407157 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407259 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407466 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407573 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407768 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.407870 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408072 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408167 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408377 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408480 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408675 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408778 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.408976 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409066 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409275 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409377 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409578 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409688 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409880 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.409970 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410181 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410291 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410506 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410596 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410818 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.410921 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411121 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411237 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411423 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411519 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411728 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.411815 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412024 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412120 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412328 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412422 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412642 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.412730 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.412945 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.413033 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.413247 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.413333 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.413546 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.413635 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.413848 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.413943 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.414150 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.414245 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.414474 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.414591 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.414777 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.414907 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.415076 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.415224 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.415373 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.415536 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.415688 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.415855 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.416006 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.416169 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.416313 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.416508 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.416849 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.417006 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.417333 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.417561 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.417650 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.417890 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:08:37.417979 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418224 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418311 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418582 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418671 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418903 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.418999 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419222 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419310 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419551 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419661 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419875 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.419999 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420184 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420282 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420491 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420585 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420805 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.420893 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421129 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421263 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421442 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421538 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421755 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.421854 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422068 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422161 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422389 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422495 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422718 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.422808 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423044 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423135 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423356 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423460 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423672 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423764 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.423989 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424081 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424301 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424401 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424704 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.424924 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425014 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425237 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425335 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425549 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425640 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425884 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.425983 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426202 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426293 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426543 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426635 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426857 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.426957 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427178 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427277 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427491 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427581 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427796 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.427893 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428103 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428193 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428408 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428508 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428712 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.428812 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429018 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429109 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429329 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429420 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429636 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429740 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.429946 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430037 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430254 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430346 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430588 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430689 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.430899 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431004 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431283 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431377 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431525 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431640 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431836 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.431927 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.432666 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.432980 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.433322 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.433421 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.433635 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.433943 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.434269 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.434609 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.434917 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.435240 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.435545 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.435850 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.436164 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.436476 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.436625 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.436785 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.436974 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437098 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437317 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437481 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437658 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437749 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.437987 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.438075 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.438314 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.438430 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.438675 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.438771 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439005 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439094 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439312 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439408 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439637 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439726 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.439981 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440117 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440282 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440387 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440589 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440683 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440901 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.440989 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441207 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441373 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441513 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441601 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441814 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.441922 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442122 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442222 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442449 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442553 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442757 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.442845 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443062 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443151 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443370 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443466 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443674 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443771 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.443996 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444093 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444303 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444397 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444607 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444694 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.444911 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445000 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445211 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445298 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445527 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445619 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445842 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.445932 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446156 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446251 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446493 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446602 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446822 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.446911 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447138 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447227 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447449 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447583 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447815 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.447958 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.448129 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.448443 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.448690 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.448788 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449006 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449094 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449338 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449426 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449656 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449757 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.449974 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450061 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450282 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450618 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450715 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.450930 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451018 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451239 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451335 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451542 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451630 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451848 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.451942 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452154 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452248 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452460 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452550 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452764 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.452860 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453069 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453156 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453375 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453464 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453700 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.453787 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454011 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454116 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454311 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454428 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454643 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454733 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.454946 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455043 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455262 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455348 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455577 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455672 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455897 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.455993 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456208 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456297 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456532 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456627 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456843 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.456939 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457154 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457247 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457456 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457549 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457769 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.457868 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458082 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458171 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458413 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458516 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458730 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.458821 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459041 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459126 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459348 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459442 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459660 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459748 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.459967 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460055 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460277 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460363 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460583 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460680 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460890 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.460978 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461195 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461281 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461507 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461639 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461820 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.461909 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462132 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462264 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462462 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462553 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462782 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.462870 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.463095 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.463194 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.463923 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.464064 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.464231 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.464544 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.464747 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.464870 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465070 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465182 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465390 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465504 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465708 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.465810 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466031 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466119 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466346 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466456 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466692 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.466782 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467007 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467095 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467333 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467420 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467637 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467770 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.467945 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468040 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468248 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468334 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468559 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468649 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468879 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.468973 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469199 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469302 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469506 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469594 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469816 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.469910 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470128 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470223 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470458 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470549 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470769 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.470857 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471080 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471252 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471391 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471480 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471695 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.471783 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472002 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472099 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472315 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472404 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472623 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472709 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.472925 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473025 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473228 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473328 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473538 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473626 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473843 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.473932 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474145 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474233 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474472 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474561 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474779 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.474868 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.475095 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.475181 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.475400 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.475670 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.475766 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476008 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476095 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476314 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476400 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476615 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476712 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.476937 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477025 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477243 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477338 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477546 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477637 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477847 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.477934 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478149 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478241 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478514 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478619 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478825 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.478922 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.479189 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.479500 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.479714 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.479870 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480045 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480191 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480369 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480556 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480691 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480833 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.480989 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481136 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481292 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481426 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481598 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481751 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.481952 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482086 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482215 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482352 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482508 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482639 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482814 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.482949 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483125 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483260 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483428 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483563 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483734 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.483869 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484045 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484179 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484351 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484504 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484635 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484764 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.484945 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485091 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485234 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485372 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485538 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485674 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485852 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.485989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.486215 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.486437 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.486594 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.486772 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.486918 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487089 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487239 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487408 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487553 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487726 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.487862 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488070 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488205 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488334 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488460 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488650 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488794 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.488943 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489074 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489248 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489397 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489537 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489666 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.489850 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490011 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490153 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490290 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490468 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490652 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490797 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.490941 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491200 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491328 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491467 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491637 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491789 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.491931 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492061 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492229 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492366 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492511 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492710 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492854 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.492984 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493122 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493250 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493389 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493518 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493699 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.493836 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.494001 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.494136 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.494318 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.494483 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.495203 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.495328 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.495579 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.495958 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.496207 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.496520 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.496608 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.496826 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.496913 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497151 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497241 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497464 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497560 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497772 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.497859 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.498079 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.498168 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.498413 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.498541 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.498972 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499116 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499284 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499431 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499594 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499741 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.499918 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500068 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500237 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500378 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500542 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500685 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.500991 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501159 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501302 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501464 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501613 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501769 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.501917 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502080 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502227 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502435 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502575 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502705 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.502889 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503008 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503199 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503502 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503623 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503812 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.503944 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504116 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504255 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504431 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504560 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504743 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.504867 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505048 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505170 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505351 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505514 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505662 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505820 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.505971 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506176 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506270 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506513 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506643 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506832 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.506936 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507151 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507248 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507464 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507552 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507766 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.507853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508070 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508206 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508372 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508458 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508677 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508763 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.508990 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509097 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509286 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509426 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509589 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509678 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509890 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.509990 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.510193 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.510329 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.511153 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.511566 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.511655 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.511884 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.511975 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512193 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512280 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512508 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512605 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512840 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.512934 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513151 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513246 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513454 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513549 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513765 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.513853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514073 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514167 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514399 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514502 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514703 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.514791 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515012 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515107 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515311 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515416 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515615 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515705 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.515917 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516005 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516221 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516309 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516520 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516612 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516827 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.516932 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517131 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517221 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517434 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517522 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517738 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.517826 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518043 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518131 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518353 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518486 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518688 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518798 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.518996 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.519155 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.519300 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.519464 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.519725 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.519828 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520037 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520134 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520348 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520443 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520650 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520752 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.520959 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521056 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521258 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521345 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521569 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521664 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521873 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.521966 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522174 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522306 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522498 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522605 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522802 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.522935 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523122 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523211 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523432 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523521 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523742 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.523829 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524062 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524158 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524374 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524469 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524693 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524781 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.524994 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525079 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525297 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525387 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525599 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525687 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.525962 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.526062 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.526549 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.526847 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.526962 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.527163 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.527385 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.527486 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.527701 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.527790 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528009 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528105 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528368 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528466 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528678 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528767 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.528983 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529080 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529294 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529419 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529603 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529697 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529907 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.529998 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530230 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530363 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530565 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530658 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530870 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.530969 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531176 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531266 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531476 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531563 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531784 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.531879 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532087 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532188 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532393 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532508 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532716 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.532811 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533039 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533139 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533352 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533440 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533680 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533769 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.533987 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.534075 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.534299 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.534414 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.534718 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.534820 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535022 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535111 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535353 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535438 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535664 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535760 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.535973 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536061 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536287 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536375 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536595 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536692 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.536896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537063 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537205 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537294 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537507 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537594 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537810 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.537905 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538110 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538207 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538429 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538538 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538737 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.538834 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539040 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539127 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539358 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539454 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539662 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539757 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.539991 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540079 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540309 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540405 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540636 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540725 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.540961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541057 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541270 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541370 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541634 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541775 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.541948 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542169 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542271 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542519 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542630 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542828 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.542918 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543139 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543227 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543446 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543536 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543768 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.543856 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544089 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544178 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544397 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544495 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544710 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.544800 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545011 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545108 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545329 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545420 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545647 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545736 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.545956 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546044 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546274 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546363 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546623 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546711 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.546934 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547035 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547250 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547340 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547559 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547647 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547867 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.547974 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548172 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548261 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548483 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548624 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548785 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.548883 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549177 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549386 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549474 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549707 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.549802 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550005 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550094 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550314 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550425 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550645 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550737 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.550951 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551046 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551248 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551334 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551549 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551638 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551866 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.551961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552171 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552259 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552490 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552624 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552800 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.552888 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553119 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553243 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553438 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553530 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553739 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.553828 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554055 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554163 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554361 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554502 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554684 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554773 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.554986 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555088 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555287 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555375 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555612 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555707 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.555914 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556009 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556232 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556319 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556545 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556641 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556860 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.556958 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.557715 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.557841 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.558036 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.558583 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.558730 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.558912 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.558999 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559228 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559324 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559543 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559641 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559858 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.559946 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560161 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560247 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560466 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560562 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560775 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.560861 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561077 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561163 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561381 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561479 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561686 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561775 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.561993 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562089 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562294 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562408 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562626 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562725 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.562930 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563018 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563249 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563376 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563554 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563651 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563875 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.563964 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564181 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564276 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564482 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564579 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564785 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.564883 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565086 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565181 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565424 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565514 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565728 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.565825 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566038 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566125 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566353 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566463 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566690 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.566859 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567008 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567098 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567313 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567397 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567623 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567720 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.567933 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568034 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568244 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568334 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568556 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568654 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568868 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.568965 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569178 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569275 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569492 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569582 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569805 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.569894 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570115 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570216 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570450 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570543 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570763 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.570977 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.571068 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.571297 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.571579 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.571668 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.571913 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.572003 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.572232 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.572333 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.572554 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.572642 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.573438 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.573774 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.573914 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574088 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574231 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574414 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574585 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574735 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.574906 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575047 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575223 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575354 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575537 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575677 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575850 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.575989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576178 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576293 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576504 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576602 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576831 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.576922 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.577170 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.577433 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.577522 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.577782 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.577873 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578093 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578431 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578536 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578761 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.578856 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579081 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579170 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579385 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579472 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579701 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.579800 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580007 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580095 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580316 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580418 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580624 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580711 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.580935 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581024 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581240 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581340 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581545 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581641 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581852 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.581940 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582161 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582258 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582494 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582591 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582805 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.582933 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583114 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583204 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583444 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583569 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583754 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.583854 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584067 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584156 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584373 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584468 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584684 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584771 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.584987 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585203 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585300 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585524 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585614 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585860 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.585961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586174 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586260 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586520 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586834 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.586924 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587140 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587227 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587452 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587540 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587757 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.587846 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.588061 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.588148 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.588428 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.588528 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.588867 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589180 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589269 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589491 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589579 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589814 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.589912 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590130 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590227 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590469 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590572 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590787 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.590883 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591097 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591184 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591443 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591625 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591764 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.591970 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.592285 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.592380 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.592611 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.592701 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.592932 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593067 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593243 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593330 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593547 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593672 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593868 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.593961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594174 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594269 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594504 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594617 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594818 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.594906 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595129 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595217 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595434 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595580 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595737 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.595833 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596048 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596136 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596353 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596449 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596745 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.596962 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597048 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597259 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597349 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597570 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597660 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597875 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.597961 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598182 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598272 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598518 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598622 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598828 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.598924 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599133 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599223 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599438 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599526 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599743 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.599839 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600046 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600136 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600357 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600445 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600658 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600757 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.600968 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601056 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601273 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601368 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601581 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601677 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601879 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.601974 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602186 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602274 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602536 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602646 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602854 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.602942 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603159 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603246 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603469 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603564 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603786 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.603882 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.604717 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605029 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605142 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605336 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605432 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605660 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605756 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.605973 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606075 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606282 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606422 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606635 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606761 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.606950 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607163 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607283 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607493 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607625 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607812 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.607954 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608146 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608280 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608477 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608589 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608783 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.608885 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609092 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609184 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609397 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609485 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609719 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.609817 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610030 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610119 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610341 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610496 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610675 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610766 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.610984 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611290 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611377 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611592 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611680 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611895 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.611982 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612195 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612281 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612499 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612595 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612800 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.612888 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613105 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613230 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613409 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613506 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613712 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.613807 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614012 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614109 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614321 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614464 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614657 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614746 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.614964 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615061 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615269 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615366 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615573 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615660 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615875 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.615976 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616177 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616266 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616526 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616629 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616789 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.616887 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617100 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617213 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617426 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617516 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617733 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.617828 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618032 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618120 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618351 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618469 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618697 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.618787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.619018 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.619106 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.619335 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.619737 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.619928 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.620131 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.620421 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.620649 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.620739 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.620979 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621069 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621306 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621404 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621622 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621711 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.621934 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622022 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622245 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622335 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622601 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622691 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622907 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.622996 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.623232 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.623374 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.623551 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.623649 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624118 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624208 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624421 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624511 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624723 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.624821 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625030 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625125 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625346 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625435 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625655 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625755 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.625954 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626041 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626256 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626345 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626590 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626681 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626893 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.626983 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627195 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627290 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627496 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627589 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627796 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.627884 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628099 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628196 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628399 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628489 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628699 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628796 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.628999 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629115 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629301 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629426 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629600 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629733 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.629900 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630022 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630204 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630338 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630531 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630677 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630834 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.630985 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.631132 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.631220 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 04:08:37.631433 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.631732 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.632059 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.632390 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.632705 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.633032 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.633342 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.633662 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.633969 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.634288 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.634633 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.634948 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.635788 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.636559 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.636874 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.637187 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.637501 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.637812 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.638122 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.638455 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.638785 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.639111 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.639416 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.639741 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.640057 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.640375 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.640688 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.640995 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.641321 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.641629 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.641936 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.642248 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.642580 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.642891 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.643204 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.643515 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.643843 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.644167 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.644476 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.644799 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.645123 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.645467 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.645777 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.646122 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.646473 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.646788 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.647097 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.647401 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:08:37.647642 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 04:08:37.714442 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO dbcounter [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Registered counter for database nova_api Jun 24 04:08:37.787962 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO dbcounter [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Registered counter for database nova_api Jun 24 04:08:37.810712 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_db.sqlalchemy.engines [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.817451 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writer thread running {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:37.829287 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_db.sqlalchemy.engines [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.835665 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writer thread running {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:37.876212 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.context [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d23276fb-df4e-471b-bff8-7999f072e73f(cell1) {{(pid=103845) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 04:08:37.880214 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:08:37.881804 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:08:37.882624 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:08:37.884552 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:08:37.887060 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO dbcounter [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Registered counter for database nova_cell0 Jun 24 04:08:37.891061 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO dbcounter [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Registered counter for database nova_cell1 Jun 24 04:08:37.894652 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.context [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d23276fb-df4e-471b-bff8-7999f072e73f(cell1) {{(pid=103844) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 04:08:37.898129 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_db.sqlalchemy.engines [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.898803 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_concurrency.lockutils [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:08:37.900257 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_concurrency.lockutils [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:08:37.900371 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_db.sqlalchemy.engines [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.901851 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_concurrency.lockutils [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:08:37.904483 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_concurrency.lockutils [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:08:37.905991 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writer thread running {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:37.906490 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO dbcounter [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Registered counter for database nova_cell0 Jun 24 04:08:37.908720 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writer thread running {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:37.910378 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO dbcounter [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Registered counter for database nova_cell1 Jun 24 04:08:37.918032 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_db.sqlalchemy.engines [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.919338 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_db.sqlalchemy.engines [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:37.925624 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writer thread running {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:37.927652 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writer thread running {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:38.060424 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO dbcounter [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Registered counter for database nova_cell0 Jun 24 04:08:38.069128 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_db.sqlalchemy.engines [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:38.073464 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writer thread running {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:38.085148 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO dbcounter [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Registered counter for database nova_cell0 Jun 24 04:08:38.094859 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG oslo_db.sqlalchemy.engines [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:08:38.099148 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writer thread running {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:08:38.533168 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: WARNING keystonemiddleware.auth_token [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:08:38.540369 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: WARNING keystonemiddleware.auth_token [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:08:38.677801 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: WARNING keystonemiddleware.auth_token [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:08:38.685526 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: WARNING keystonemiddleware.auth_token [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:08:38.905608 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: WARNING keystonemiddleware.auth_token [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:08:38.911831 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: WARNING keystonemiddleware.auth_token [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:08:38.917265 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654abc279c0 pid: 103845 (default app) Jun 24 04:08:38.919584 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:08:38.920801 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001928 Jun 24 04:08:38.921232 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Jun 24 04:08:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:08:39.030445 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: WARNING keystonemiddleware.auth_token [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:08:39.041031 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: WARNING keystonemiddleware.auth_token [None req-8e884884-2699-4dfa-947e-ab46d55ebe4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:08:39.051611 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654abc279c0 pid: 103844 (default app) Jun 24 04:09:57.292527 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:09:57.294406 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Jun 24 04:09:57.295195 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:09:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:09:57.313572 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_api:SELECT=3 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:09:57.314901 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_cell1:SELECT=3 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:09:57.315764 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_cell0:SELECT=3 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:09:57.316785 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:09:57.745660 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-0f1ea09d-8a56-4fee-9c4b-70c8bb6ed15c admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:09:57.775542 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-0f1ea09d-8a56-4fee-9c4b-70c8bb6ed15c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472433 Jun 24 04:09:57.776181 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jun 24 04:09:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:09:59.888154 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:09:59.889156 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-2322da95-016c-4352-be6d-4da2b00e468a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 24 04:09:59.889548 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:09:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:09:59.950895 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-05918d94-13c5-4c17-9ed1-ec9856d57067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:09:59.971349 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:09:59.971349 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: warnings.warn(msg) Jun 24 04:10:00.065996 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-05918d94-13c5-4c17-9ed1-ec9856d57067 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.170321 Jun 24 04:10:00.067268 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:09:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:00.081141 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_api:SELECT=3 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:00.082563 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_cell0:SELECT=3 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:00.083668 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_cell1:SELECT=3 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:00.084435 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:00.296208 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-b6df289e-c3ac-4afe-9068-10f4f63b0993 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:00.298523 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:10:00.298523 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:10:00.457304 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-b6df289e-c3ac-4afe-9068-10f4f63b0993 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.381527 Jun 24 04:10:00.457887 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jun 24 04:10:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:02.562499 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-05918d94-13c5-4c17-9ed1-ec9856d57067 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:02.563461 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-05918d94-13c5-4c17-9ed1-ec9856d57067 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 24 04:10:02.564007 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:02.670332 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-aa39f339-312e-4bf9-a9f6-f9b9ff8d0cdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:02.691749 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:10:02.691749 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:10:02.792775 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-aa39f339-312e-4bf9-a9f6-f9b9ff8d0cdc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.223168 Jun 24 04:10:02.793350 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:02.805971 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-0999705e-3fe5-4446-9b2d-a471370c1219 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:02.807711 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:10:02.807711 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: warnings.warn(msg) Jun 24 04:10:02.907087 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-0999705e-3fe5-4446-9b2d-a471370c1219 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105553 Jun 24 04:10:02.907668 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jun 24 04:10:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:10:05.027996 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-aa39f339-312e-4bf9-a9f6-f9b9ff8d0cdc admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:05.029009 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-aa39f339-312e-4bf9-a9f6-f9b9ff8d0cdc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 24 04:10:05.029938 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:05.092643 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-bb929ca0-b166-47de-949c-4925fb92b711 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:05.183018 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-bb929ca0-b166-47de-949c-4925fb92b711 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146648 Jun 24 04:10:05.183580 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:05.197059 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-bfee1f4c-cbdd-41fb-b1bb-114c79ed6bbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:05.305229 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-bfee1f4c-cbdd-41fb-b1bb-114c79ed6bbb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111891 Jun 24 04:10:05.305968 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jun 24 04:10:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:07.427559 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-bb929ca0-b166-47de-949c-4925fb92b711 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:07.428586 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-bb929ca0-b166-47de-949c-4925fb92b711 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Jun 24 04:10:07.428995 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:07.488747 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-f97b033e-d97e-463d-b6c9-e2390a0918a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "swap": 0, "vcpus": 2, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:07.545685 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-f97b033e-d97e-463d-b6c9-e2390a0918a6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.110576 Jun 24 04:10:07.546256 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 04:10:07.558275 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-f661c260-f025-4a0d-bb51-707fdb653b20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:07.629329 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-f661c260-f025-4a0d-bb51-707fdb653b20 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074798 Jun 24 04:10:07.634708 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jun 24 04:10:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:09.726970 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-f97b033e-d97e-463d-b6c9-e2390a0918a6 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:09.729104 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-f97b033e-d97e-463d-b6c9-e2390a0918a6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003178 Jun 24 04:10:09.731404 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:09.799090 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:09.872415 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134501 Jun 24 04:10:09.872975 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 04:10:09.885119 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-3a889617-53fe-4e91-ac57-a779e744de9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:09.955800 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-3a889617-53fe-4e91-ac57-a779e744de9c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074478 Jun 24 04:10:09.956574 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jun 24 04:10:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:10:12.058115 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:12.059087 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 24 04:10:12.059484 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:12.125716 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-9ff74a17-1a1f-4437-b7af-b38254e09703 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:12.151092 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-9ff74a17-1a1f-4437-b7af-b38254e09703 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085375 Jun 24 04:10:12.151638 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jun 24 04:10:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:10:14.295609 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:14.296562 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-6f92ae99-76e0-4bd6-8426-1a17e199d26d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 24 04:10:14.296967 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:14.364651 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-21b73954-ae47-45bb-a17f-22acf042967a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:14.415498 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-21b73954-ae47-45bb-a17f-22acf042967a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.111439 Jun 24 04:10:14.416095 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:14.429977 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-92496b9b-f4e8-48f3-9477-0e68d1a9d60d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:14.487749 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-92496b9b-f4e8-48f3-9477-0e68d1a9d60d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063228 Jun 24 04:10:14.488532 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jun 24 04:10:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:16.601587 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-21b73954-ae47-45bb-a17f-22acf042967a admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:16.602645 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-21b73954-ae47-45bb-a17f-22acf042967a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 24 04:10:16.603048 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:10:16.675409 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-da07b930-9bd3-480f-9dcb-787e4b7e99d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:16.740399 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-da07b930-9bd3-480f-9dcb-787e4b7e99d4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131342 Jun 24 04:10:16.741045 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:16.753626 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-70bb1e51-63b5-4ea7-8f34-25d909ef89ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:16.818253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-70bb1e51-63b5-4ea7-8f34-25d909ef89ae admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068554 Jun 24 04:10:16.818846 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jun 24 04:10:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:19.036920 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-da07b930-9bd3-480f-9dcb-787e4b7e99d4 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:19.038098 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-da07b930-9bd3-480f-9dcb-787e4b7e99d4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Jun 24 04:10:19.039691 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:19.130176 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-024f08d3-2a11-4021-bf76-84856a2d9cda admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:19.186068 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-024f08d3-2a11-4021-bf76-84856a2d9cda admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140619 Jun 24 04:10:19.186579 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:19.198383 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-d2e17a0a-9584-4e1d-936a-900ccb8fa460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:19.265689 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-d2e17a0a-9584-4e1d-936a-900ccb8fa460 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070958 Jun 24 04:10:19.266417 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jun 24 04:10:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:21.374356 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-024f08d3-2a11-4021-bf76-84856a2d9cda admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:21.375757 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-024f08d3-2a11-4021-bf76-84856a2d9cda admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001863 Jun 24 04:10:21.376227 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:21.434868 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-875a84e0-5df4-4356-a99c-3c185ba24dae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:21.505879 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-875a84e0-5df4-4356-a99c-3c185ba24dae admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123748 Jun 24 04:10:21.506642 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:21.519608 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-60bb4ce0-930c-4795-904e-3fe9225533d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:21.612158 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-60bb4ce0-930c-4795-904e-3fe9225533d6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096222 Jun 24 04:10:21.612695 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jun 24 04:10:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:10:23.719801 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-875a84e0-5df4-4356-a99c-3c185ba24dae admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:23.721591 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-875a84e0-5df4-4356-a99c-3c185ba24dae admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Jun 24 04:10:23.722018 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:23.783867 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5"}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:23.859699 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.131099 Jun 24 04:10:23.860675 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jun 24 04:10:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 04:10:23.876750 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-4a48aadc-9a56-497c-8f36-880a9dd7f39e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:23.951827 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-4a48aadc-9a56-497c-8f36-880a9dd7f39e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078930 Jun 24 04:10:23.952635 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jun 24 04:10:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:10:49.598841 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:49.599805 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 24 04:10:49.600208 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:49.611197 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:49.660127 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-6a559dd2-989a-4783-b51e-f23c4c951961 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:49.678814 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-6a559dd2-989a-4783-b51e-f23c4c951961 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072124 Jun 24 04:10:49.680529 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jun 24 04:10:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:50.594131 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:50.595175 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-3b85003a-018a-4479-8653-0dc2b7bf699f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 24 04:10:50.595572 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:50.786103 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-1f77ffd3-4e16-42a1-8501-dacb38b344c9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:50.792330 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.wsgi [None req-1f77ffd3-4e16-42a1-8501-dacb38b344c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-1f77ffd3-4e16-42a1-8501-dacb38b344c9 admin admin] Request method failure captured: Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept: application/json Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept-Encoding: gzip, deflate Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Connection: keep-alive Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Content-Length: 0 Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Host: 10.222.0.16 Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-System-Scope: None Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: User-Agent: python-novaclient Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Auth-Token: gAAAAABitTlKJua0gcXiAymJ0tnBX8Wob8Zc18s8LfO1Q6kpNy0cVqqWcgpTYMhssEnp1QHwfK_EyJpt7QL7muF0CeKe3pnt6pERDU3fy-RjalgwoB3sm0AaA2DmDBsZsjYr9AaQDb4WgD5QqE8prNxHePRJu-7wH6nuSsiCOZO3kot9IHXD2TM Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Id: None Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Name: None Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Identity-Status: Confirmed Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Is-Admin-Project: True Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Id: default Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Name: Default Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Name: admin Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Role: reader,member,admin Jun 24 04:10:50.795612 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Roles: reader,member,admin Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant: admin Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Name: admin Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User: admin Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Id: default Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Name: Default Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Name: admin Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: method: > Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: exception: Flavor 42 could not be found. Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: action_args: {'id': '42'} Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:50.797265 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:50.798211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.799402 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-1f77ffd3-4e16-42a1-8501-dacb38b344c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:50.800462 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-1f77ffd3-4e16-42a1-8501-dacb38b344c9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062629 Jun 24 04:10:50.800462 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jun 24 04:10:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 04:10:50.806757 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-3139e275-f01f-437b-a979-c71278635748 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:50.809625 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:10:50.827852 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-3139e275-f01f-437b-a979-c71278635748 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024860 Jun 24 04:10:50.828391 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:50.838629 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-2194a1c6-0017-499c-a756-b710b72ee304 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:50.860109 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-2194a1c6-0017-499c-a756-b710b72ee304 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025739 Jun 24 04:10:50.860642 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:50.869752 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-ef28ef63-6c54-45a5-9aa6-ddc21632cb17 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:50.876026 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.wsgi [None req-ef28ef63-6c54-45a5-9aa6-ddc21632cb17 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-ef28ef63-6c54-45a5-9aa6-ddc21632cb17 admin admin] Request method failure captured: Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept: application/json Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept-Encoding: gzip, deflate Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Connection: keep-alive Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Content-Length: 0 Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Host: 10.222.0.16 Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-System-Scope: None Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: User-Agent: python-novaclient Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Auth-Token: gAAAAABitTlKJua0gcXiAymJ0tnBX8Wob8Zc18s8LfO1Q6kpNy0cVqqWcgpTYMhssEnp1QHwfK_EyJpt7QL7muF0CeKe3pnt6pERDU3fy-RjalgwoB3sm0AaA2DmDBsZsjYr9AaQDb4WgD5QqE8prNxHePRJu-7wH6nuSsiCOZO3kot9IHXD2TM Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Id: None Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Name: None Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Identity-Status: Confirmed Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Is-Admin-Project: True Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Id: default Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Name: Default Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Name: admin Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Role: reader,member,admin Jun 24 04:10:50.879285 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Roles: reader,member,admin Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant: admin Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Name: admin Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User: admin Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Id: default Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Name: Default Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Name: admin Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: method: > Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: exception: Flavor 42 could not be found. Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: action_args: {'id': '42'} Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:50.880853 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:50.881823 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:50.887989 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-ef28ef63-6c54-45a5-9aa6-ddc21632cb17 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:50.889225 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-ef28ef63-6c54-45a5-9aa6-ddc21632cb17 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014571 Jun 24 04:10:50.889225 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jun 24 04:10:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 04:10:51.719475 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-2194a1c6-0017-499c-a756-b710b72ee304 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:51.720463 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-2194a1c6-0017-499c-a756-b710b72ee304 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 24 04:10:51.720847 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:51.910145 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-715d1586-d3c9-4a51-bad8-edb6b6110cd6 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:51.918734 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.wsgi [None req-715d1586-d3c9-4a51-bad8-edb6b6110cd6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-715d1586-d3c9-4a51-bad8-edb6b6110cd6 admin admin] Request method failure captured: Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept: application/json Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept-Encoding: gzip, deflate Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Connection: keep-alive Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Content-Length: 0 Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Host: 10.222.0.16 Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-System-Scope: None Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: User-Agent: python-novaclient Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Auth-Token: gAAAAABitTlLLeP2Jwk7G9I9iXuDYQPCqRdw2TyXC9Up0pk_wfPIRYudclPSH05ou2h9K0P9IaGiwwcDN7mQfpGyLwDqEQjv7Lsxy0WnjBELfg8UeetwL1V-FsKqURUNSpVxPisWPpP9vO9ffI-MNkIeK_jgDU0XrxjhO_STmqMK0dcQSR-CM8g Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Id: None Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Name: None Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Identity-Status: Confirmed Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Is-Admin-Project: True Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Id: default Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Name: Default Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Name: admin Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Role: reader,member,admin Jun 24 04:10:51.920253 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Roles: reader,member,admin Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant: admin Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Name: admin Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User: admin Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Id: default Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Name: Default Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Name: admin Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: method: > Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: exception: Flavor 84 could not be found. Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: action_args: {'id': '84'} Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:51.927613 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:51.928628 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.930319 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-715d1586-d3c9-4a51-bad8-edb6b6110cd6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:51.931502 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-715d1586-d3c9-4a51-bad8-edb6b6110cd6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063031 Jun 24 04:10:51.931502 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jun 24 04:10:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 04:10:51.932370 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-1c083cb1-1f6e-47d3-9086-5445ee06bf94 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:51.945844 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-1c083cb1-1f6e-47d3-9086-5445ee06bf94 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017859 Jun 24 04:10:51.946412 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:51.955930 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-0b78fedf-9298-4ff0-a886-684cb8050f93 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:51.969611 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-0b78fedf-9298-4ff0-a886-684cb8050f93 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017494 Jun 24 04:10:51.970121 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:51.979435 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-2ae046e2-d10c-4244-95fe-65ee412a48a7 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:51.984725 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.wsgi [None req-2ae046e2-d10c-4244-95fe-65ee412a48a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-2ae046e2-d10c-4244-95fe-65ee412a48a7 admin admin] Request method failure captured: Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept: application/json Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept-Encoding: gzip, deflate Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Connection: keep-alive Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Content-Length: 0 Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Host: 10.222.0.16 Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-System-Scope: None Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: User-Agent: python-novaclient Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Auth-Token: gAAAAABitTlLLeP2Jwk7G9I9iXuDYQPCqRdw2TyXC9Up0pk_wfPIRYudclPSH05ou2h9K0P9IaGiwwcDN7mQfpGyLwDqEQjv7Lsxy0WnjBELfg8UeetwL1V-FsKqURUNSpVxPisWPpP9vO9ffI-MNkIeK_jgDU0XrxjhO_STmqMK0dcQSR-CM8g Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Id: None Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Name: None Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Identity-Status: Confirmed Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Is-Admin-Project: True Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Id: default Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Name: Default Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Name: admin Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Role: reader,member,admin Jun 24 04:10:51.986218 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Roles: reader,member,admin Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant: admin Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Name: admin Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User: admin Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Id: default Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Name: Default Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Name: admin Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: method: > Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: exception: Flavor 84 could not be found. Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: action_args: {'id': '84'} Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:51.987787 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:51.988896 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:51.990276 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-2ae046e2-d10c-4244-95fe-65ee412a48a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:51.991551 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-2ae046e2-d10c-4244-95fe-65ee412a48a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012134 Jun 24 04:10:51.991551 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jun 24 04:10:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 04:10:52.823866 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-0b78fedf-9298-4ff0-a886-684cb8050f93 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:52.824865 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-0b78fedf-9298-4ff0-a886-684cb8050f93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 24 04:10:52.825256 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:53.012753 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-dbd103c7-6e3b-4066-87c5-3efaab932604 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:53.018525 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.wsgi [None req-dbd103c7-6e3b-4066-87c5-3efaab932604 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-dbd103c7-6e3b-4066-87c5-3efaab932604 admin admin] Request method failure captured: Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept: application/json Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Accept-Encoding: gzip, deflate Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Connection: keep-alive Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Content-Length: 0 Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Host: 10.222.0.16 Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Openstack-System-Scope: None Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: User-Agent: python-novaclient Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Auth-Token: gAAAAABitTlMfRsKM9K88xnF2Vekpd5T0XEdXBQzP2OjRRAEj9oxd7qNqVtTm-UENgD4yWnOlj1U8wsXuxjTz7IQ66OOBxxxexH4VV5WXbdwj5PhqPuQm08s0oN5yTqtQs0yhwgMCspLTkLsKL9gJhH-_V78azTBekE-bYLayVzMOqt4X9SV1nc Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Id: None Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Domain-Name: None Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Identity-Status: Confirmed Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Is-Admin-Project: True Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Id: default Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Domain-Name: Default Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Project-Name: admin Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Role: reader,member,admin Jun 24 04:10:53.020017 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Roles: reader,member,admin Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant: admin Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-Tenant-Name: admin Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User: admin Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Id: default Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Domain-Name: Default Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: X-User-Name: admin Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: method: > Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: exception: Flavor 451 could not be found. Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: action_args: {'id': '451'} Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:53.021509 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:53.022655 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.025071 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-dbd103c7-6e3b-4066-87c5-3efaab932604 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:53.026289 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-dbd103c7-6e3b-4066-87c5-3efaab932604 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060910 Jun 24 04:10:53.026289 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:10:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 04:10:53.031622 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-b7713913-d73b-45f3-a08f-08482946c83e admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:53.045973 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-b7713913-d73b-45f3-a08f-08482946c83e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017937 Jun 24 04:10:53.046546 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:53.056132 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:53.070854 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018229 Jun 24 04:10:53.071378 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jun 24 04:10:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:10:53.080601 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-d865a836-6b87-4928-a002-5dfcbc631b60 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:53.086600 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.wsgi [None req-d865a836-6b87-4928-a002-5dfcbc631b60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-d865a836-6b87-4928-a002-5dfcbc631b60 admin admin] Request method failure captured: Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept: application/json Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Accept-Encoding: gzip, deflate Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Connection: keep-alive Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Content-Length: 0 Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Host: 10.222.0.16 Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-Api-Version: compute 2.90 Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Openstack-System-Scope: None Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: User-Agent: python-novaclient Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Auth-Token: gAAAAABitTlMfRsKM9K88xnF2Vekpd5T0XEdXBQzP2OjRRAEj9oxd7qNqVtTm-UENgD4yWnOlj1U8wsXuxjTz7IQ66OOBxxxexH4VV5WXbdwj5PhqPuQm08s0oN5yTqtQs0yhwgMCspLTkLsKL9gJhH-_V78azTBekE-bYLayVzMOqt4X9SV1nc Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Id: None Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Domain-Name: None Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Identity-Status: Confirmed Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Is-Admin-Project: True Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Id: default Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Domain-Name: Default Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Project-Name: admin Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Role: reader,member,admin Jun 24 04:10:53.088087 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Roles: reader,member,admin Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a1c0f0b20b844d7b8311813151d93aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a1c0f0b20b844d7b8311813151d93aa"}]}] Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant: admin Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Id: 6a1c0f0b20b844d7b8311813151d93aa Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-Tenant-Name: admin Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User: admin Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Id: default Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Domain-Name: Default Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Id: c531d2732de94f47a66f16db7047917f Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: X-User-Name: admin Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: method: > Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: exception: Flavor 451 could not be found. Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: action_args: {'id': '451'} Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:10:53.089616 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:53.090567 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: ERROR nova.api.openstack.wsgi Jun 24 04:10:53.091915 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-d865a836-6b87-4928-a002-5dfcbc631b60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:10:53.093251 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-d865a836-6b87-4928-a002-5dfcbc631b60 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012471 Jun 24 04:10:53.093251 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:10:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 04:10:53.921247 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:53.922310 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 24 04:10:53.922726 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:54.109777 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-0d59e27a-3ae2-47d1-baa0-2759af78fca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:54.213393 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-0d59e27a-3ae2-47d1-baa0-2759af78fca5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.155063 Jun 24 04:10:54.213858 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jun 24 04:10:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:55.044055 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:55.045062 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 24 04:10:55.045460 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:55.236931 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-175d150a-3285-44e0-b710-584aef239fa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:55.315453 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-175d150a-3285-44e0-b710-584aef239fa7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.130614 Jun 24 04:10:55.315994 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jun 24 04:10:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:56.145310 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:56.146312 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 24 04:10:56.146745 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:56.338290 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-8464f7a0-1ae0-4ca4-9096-4a40aa573420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:56.413064 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-8464f7a0-1ae0-4ca4-9096-4a40aa573420 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.127233 Jun 24 04:10:56.413855 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jun 24 04:10:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:57.246765 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:57.247799 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 24 04:10:57.248192 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:57.438031 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-654b405f-47f2-410d-9d45-9cc46213358a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:10:57.510216 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-654b405f-47f2-410d-9d45-9cc46213358a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.123789 Jun 24 04:10:57.510799 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jun 24 04:10:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:10:58.338211 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:58.339286 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 24 04:10:58.339677 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:10:58.528280 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-0d3f3e8f-76d8-4d6d-8c3f-7f671bf01dc2 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:10:58.547048 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-0d3f3e8f-76d8-4d6d-8c3f-7f671bf01dc2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071009 Jun 24 04:10:58.547519 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Jun 24 04:10:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:11:46.650678 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.651684 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-a0d054a4-4bae-46b3-999c-c27dbab950e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 24 04:11:46.652072 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:11:46.662154 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:11:46.710649 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-31116d20-8693-4e85-843f-98daa1570b88 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.729890 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-31116d20-8693-4e85-843f-98daa1570b88 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072170 Jun 24 04:11:46.730439 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:11:46.753351 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-ffe11098-4e9c-4cbf-aa4a-643a400a90ff admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.757327 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG dbcounter [-] [103844] Writing DB stats nova_api:SELECT=14 {{(pid=103844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:11:46.762199 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-ffe11098-4e9c-4cbf-aa4a-643a400a90ff admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012553 Jun 24 04:11:46.762749 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:11:46.774206 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-7bbe2e0a-e98e-47e6-b4c8-70c596771729 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.781805 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-7bbe2e0a-e98e-47e6-b4c8-70c596771729 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011177 Jun 24 04:11:46.782315 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:11:46.794290 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.802015 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Jun 24 04:11:46.802581 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:11:46.813990 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-a5fda2de-fbfc-45d2-8434-84f2b1bd73d2 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:11:46.821375 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-a5fda2de-fbfc-45d2-8434-84f2b1bd73d2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010785 Jun 24 04:11:46.821883 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jun 24 04:11:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:15:13.504327 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:13.505350 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jun 24 04:15:13.505746 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:15:13.649056 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_api:SELECT=6 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:15:13.763901 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:13.765116 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:15:13.765116 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:15:13.766335 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:13.766809 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:13.767589 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:13.768015 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:13.802907 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-51f8fbb2-1a91-42a4-9a27-2db5739d9454 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155135 Jun 24 04:15:13.803468 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:15:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:15:14.643353 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:14.644837 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Jun 24 04:15:14.645494 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:15:14.838099 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:14.839295 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:15:14.839295 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:15:14.840478 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:14.840918 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:14.841696 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:14.842175 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:14.861431 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-8f3e7d87-8f1c-489e-9713-fda2c240fe04 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074613 Jun 24 04:15:14.861903 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:15:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:15:26.106948 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:26.107959 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 24 04:15:26.108354 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:15:26.261054 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_cell0:SELECT=4 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:15:26.261790 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_cell1:SELECT=4 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:15:26.262362 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG dbcounter [-] [103845] Writing DB stats nova_api:SELECT=8 {{(pid=103845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:15:26.316159 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:26.317321 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:15:26.317321 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:15:26.318520 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:26.318973 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:26.319749 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:26.320173 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:26.347751 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-d18b3454-1bb9-4c1d-9eac-e3da39148c2b admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090525 Jun 24 04:15:26.348509 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:15:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:15:27.192833 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: DEBUG nova.api.openstack.wsgi [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] Calling method '>' {{(pid=103844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:27.193845 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: INFO nova.api.openstack.requestlog [None req-08f1d103-9655-48db-a72b-c379a8131edc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 04:15:27.194246 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: [pid: 103844|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jun 24 04:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:15:27.387600 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG nova.api.openstack.wsgi [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] Calling method '>' {{(pid=103845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:15:27.389257 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 04:15:27.389257 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: warnings.warn(msg) Jun 24 04:15:27.390510 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:27.390960 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:27.391762 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:15:27.392196 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: DEBUG oslo_concurrency.lockutils [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:15:27.415214 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: INFO nova.api.openstack.requestlog [None req-b091e53c-9634-49c4-a06c-a91a87220f2a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080569 Jun 24 04:15:27.415776 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: [pid: 103845|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jun 24 04:15:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:16:24.751851 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: Fri Jun 24 04:16:24 2022 - graceful shutdown triggered... Jun 24 04:16:24.752381 dv-cinder-846842-3-iscsi devstack@n-api.service[103844]: Gracefully killing worker 1 (pid: 103844)... Jun 24 04:16:24.752834 dv-cinder-846842-3-iscsi devstack@n-api.service[103845]: Gracefully killing worker 2 (pid: 103845)... Jun 24 04:16:24.753864 dv-cinder-846842-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 04:16:25.752761 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: worker 1 buried after 1 seconds Jun 24 04:16:25.752761 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: worker 2 buried after 1 seconds Jun 24 04:16:25.753403 dv-cinder-846842-3-iscsi devstack@n-api.service[103843]: goodbye to uWSGI. Jun 24 04:16:25.754346 dv-cinder-846842-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 04:16:25.754915 dv-cinder-846842-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 04:16:25.757647 dv-cinder-846842-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 04:16:25.767472 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 04:16:25 2022] *** Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: nodename: dv-cinder-846842-3-iscsi Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: machine: x86_64 Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: clock source: unix Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: pcre jit disabled Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: detected number of CPU cores: 4 Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: current working directory: / Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: detected binary path: /usr/bin/uwsgi-core Jun 24 04:16:25.769474 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: your processes number limit is 47680 Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: your memory page size is 4096 bytes Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: detected max file descriptor number: 2048 Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: lock engine: pthread robust mutexes Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: thunder lock: enabled Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 04:16:25.770362 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: Python main interpreter initialized at 0x557f001ad9c0 Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: python threads support enabled Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: your server socket listen backlog is limited to 100 connections Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: your mercy for graceful operations on workers is 90 seconds Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 04:16:25.814883 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: *** Operational MODE: preforking *** Jun 24 04:16:25.815413 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: *** uWSGI is running in multiple interpreter mode *** Jun 24 04:16:25.815413 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: spawned uWSGI master process (pid: 118314) Jun 24 04:16:25.815179 dv-cinder-846842-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 04:16:25.816224 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: spawned uWSGI worker 1 (pid: 118330, cores: 1) Jun 24 04:16:25.816224 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: spawned uWSGI worker 2 (pid: 118331, cores: 1) Jun 24 04:16:25.816546 dv-cinder-846842-3-iscsi devstack@n-api.service[118314]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 04:16:26.476891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 04:16:26.480986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 04:16:27.705248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:16:27.705248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: from cryptography.utils import int_from_bytes Jun 24 04:16:27.705902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:16:27.705902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: from cryptography.utils import int_from_bytes Jun 24 04:16:27.706331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:16:27.706331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: from cryptography.utils import int_from_bytes Jun 24 04:16:27.706503 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 04:16:27.706503 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: from cryptography.utils import int_from_bytes Jun 24 04:16:30.181607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 04:16:30.182312 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 04:16:30.182655 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 04:16:30.182775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 04:16:30.182999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 04:16:30.183383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.183704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.184022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.184337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.184664 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.184977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.185292 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.185607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.185930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.186187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.186518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.186842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-3-iscsi {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.187023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 04:16:30.187428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.187534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 04:16:30.187626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.187803 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 04:16:30.187899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.188090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.188189 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 04:16:30.188481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 04:16:30.188619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.188829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.188958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.189145 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.189253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.189579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.189751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.189925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.190230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.190579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.190944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.191217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.191470 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.191693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.191909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.192116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.192343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.192586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.192836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.193056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.193277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-3-iscsi {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.193498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.193729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.193974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.194215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.194438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.194688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.194911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.195127 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.195333 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.195550 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.195758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-3-iscsi {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.195982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.196187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.196377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.196576 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.196766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.196954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.197141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.197290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.197457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.197611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.197769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.198842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.199001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.200450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.200652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.200807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.200961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201261 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.201903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-3-iscsi {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.202087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.202233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.202499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203285 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203584 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.203904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.204671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.204857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205850 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.205994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206146 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206146 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.206957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207713 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.207868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.208944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.209213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.209378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.209536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.209688 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.210253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.210626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.210792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.210937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211536 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211823 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.211966 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212380 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.212977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.213154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.213469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.213627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.213781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.213925 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.214936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215077 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.215949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216110 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216110 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216496 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.216957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217484 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.217918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218268 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218545 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218633 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218818 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.218910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.219584 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.220563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.220681 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.220769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.220861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.220947 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.221906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222238 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222332 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.222990 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.223994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224394 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224394 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.224999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225710 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.225912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.226982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.227888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.228097 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.228197 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.228408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.228506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.228719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.228823 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.229026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.229128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.229336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.229438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.229644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.229750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.229954 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.230052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.230260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.230607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.230728 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.230817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.230902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.230993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.231196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.231296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.231500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.231591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.231807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.231914 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.232114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.232211 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.232420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.232520 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.232731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.232828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 04:16:30.233057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.233163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.233370 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.233469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.233689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.233824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234124 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234663 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.234988 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.235088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.235330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.235441 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.235646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.235832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236623 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.236916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.237149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.237267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.237509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.237695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.237840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238236 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238441 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.238888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239587 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.239897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240400 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.240975 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241086 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.241924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.242046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.242237 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.242633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.242774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.242904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243152 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243381 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.243703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244007 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.244939 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245244 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.245951 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.246949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.247158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.247257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.247466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.247901 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.247991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248718 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.248815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249028 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249168 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249652 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.249961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.250121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.250294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.250423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.250653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.250957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251332 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251714 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.251925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252241 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.252948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253172 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253286 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253576 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.253952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.254856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.255800 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256000 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.256911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257521 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.257913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258441 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258550 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.258840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259672 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.259970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260077 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.260911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261152 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261334 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.261930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.262871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.263799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.264920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265020 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265867 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.265968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.266176 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.266333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267045 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267156 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267632 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.267955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268597 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.268915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269313 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.269933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.270148 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.270249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.270478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.270895 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271189 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271375 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271502 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.271965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272374 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272694 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.272899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273520 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.273924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.274915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275216 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275759 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.275858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276471 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276670 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.276974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277077 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277589 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.277897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278003 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278202 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278525 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278837 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.278943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279547 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.279920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280472 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.280992 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.281999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.282306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.282451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.282641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.282798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.282977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283426 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283744 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.283872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284496 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284771 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.284992 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.285092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.285386 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.285479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.285697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.285791 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286005 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286432 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.286967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.287977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288496 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.288946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.289838 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290488 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.290783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.291978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.292925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293143 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.293894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294086 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294204 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294524 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.294842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295355 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.295976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.296980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.297173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.297276 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.297471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.297572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.298307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.298490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.298645 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.298895 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.299996 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300820 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.300914 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.301885 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302050 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302143 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302380 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.302791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303315 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303623 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303736 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.303923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304017 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304525 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.304933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305524 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305737 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.305838 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.306980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307286 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307461 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.307897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308139 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308240 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.308865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309064 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.309979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.310916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.311960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312739 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.312831 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.313821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314040 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.314995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315299 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.315920 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316636 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.316835 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317139 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317443 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.317876 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.318967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319095 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319397 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.319993 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320493 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320819 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.320911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.321854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.322795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323313 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.323916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.324927 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.325849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326052 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.326808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327425 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.327945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328352 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328652 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.328865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.329515 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.329744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.329830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.330811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331312 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.331927 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332552 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.332959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333162 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.333866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334072 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334452 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334550 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.334895 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.335819 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336044 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.336982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337374 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.337902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.338988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339195 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.339910 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340115 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.340865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341181 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341664 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.341801 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.342809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343142 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.343862 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344045 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344139 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344456 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344743 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.344840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345374 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345605 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.345804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346004 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.346987 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347087 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.347938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348237 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348452 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.348953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.349923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350152 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350803 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.350912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.351829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.352963 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.353972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.354193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.354286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.354526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.354784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.354877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.355915 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356522 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.356997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357118 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.357906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358565 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.358882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359630 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.359932 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360800 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.360892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361519 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.361839 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362488 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.362974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363378 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.363888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.364924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365143 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365247 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365546 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.365918 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366061 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.366900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.367959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368595 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.368910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369127 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.369855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.370794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371011 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.371938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372247 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372374 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.372867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.373831 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.374994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.375133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.375301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.375461 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.375609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.376325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.376460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.376731 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.376822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377382 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377483 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.377795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378674 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378776 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.378990 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379095 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379396 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379621 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.379952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380265 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380598 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.380923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.381842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382503 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.382814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383329 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383424 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.383961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384400 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.384918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385048 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.385856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386380 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386753 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.386964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387385 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387629 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.387942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388375 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.388977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389583 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.389892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.390834 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.391046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.391147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.391353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.392959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.393183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.393421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.393525 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.393741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.393835 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.394893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.395068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.395212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.395374 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.395477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.395944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396052 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396566 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.396965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397182 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.397892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398436 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398762 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.398856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399079 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.399969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400624 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.400927 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401334 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.401957 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402153 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.402953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403094 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403402 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403495 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.403811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404743 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.404950 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405673 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.405983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406853 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.406956 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.407189 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.407470 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.407568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.407795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.407884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408106 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408426 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.408827 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409077 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409495 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.409775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410086 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410314 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.410963 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411057 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411368 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.411999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412303 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412512 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412605 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.412928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.413872 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.414058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.414316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.414463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.414686 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.414787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415110 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415743 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.415952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416053 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416267 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416368 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416575 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.416980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.417912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418447 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418546 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.418955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419265 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.419898 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420019 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420655 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.420977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.421155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.421472 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.421779 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426803 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.426980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427895 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.427974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428352 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428576 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428886 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.428971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429503 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429716 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429866 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.429941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430013 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.430916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.431124 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.431251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.431586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.431881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.431977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432267 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.432916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.433968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.434070 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.434395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.434590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.434730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.434932 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435894 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.435994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.436221 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.436458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.436551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.436784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.436885 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437208 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.437868 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.438081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.438184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.438945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439733 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.439945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.440999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441512 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.441923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442131 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442584 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.442899 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.443116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.443237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.443437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.443571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.443754 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444160 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444483 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.444793 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445452 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.445973 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.446076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.446277 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.446437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.446557 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 04:16:30.446651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.446975 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.447299 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.447617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.447979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.448317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.448650 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.448964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.449297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.449618 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.449944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.450262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.450604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.458523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 04:16:30.459865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 04:16:30.510334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Registered counter for database nova_api Jun 24 04:16:30.524298 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO dbcounter [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Registered counter for database nova_api Jun 24 04:16:30.531637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.538975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.544579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_db.sqlalchemy.engines [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.551323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writer thread running {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.595750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.context [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d23276fb-df4e-471b-bff8-7999f072e73f(cell1) {{(pid=118331) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 04:16:30.599999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:16:30.601563 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:16:30.602357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:16:30.604390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:16:30.606346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Registered counter for database nova_cell0 Jun 24 04:16:30.609474 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.context [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d23276fb-df4e-471b-bff8-7999f072e73f(cell1) {{(pid=118330) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 04:16:30.610423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Registered counter for database nova_cell1 Jun 24 04:16:30.613753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:16:30.615417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:16:30.616234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:16:30.617678 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.618225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:16:30.619757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.620967 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO dbcounter [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Registered counter for database nova_cell0 Jun 24 04:16:30.625128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO dbcounter [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Registered counter for database nova_cell1 Jun 24 04:16:30.627417 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.628768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.632836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_db.sqlalchemy.engines [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.634592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_db.sqlalchemy.engines [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.640665 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writer thread running {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.642610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writer thread running {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.792052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO dbcounter [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Registered counter for database nova_cell0 Jun 24 04:16:30.792463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_db.sqlalchemy.engines [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.797159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writer thread running {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:30.797285 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO dbcounter [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Registered counter for database nova_cell0 Jun 24 04:16:30.803898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_db.sqlalchemy.engines [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 04:16:30.808577 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writer thread running {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 04:16:31.118942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:16:31.126865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:16:31.134936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: WARNING keystonemiddleware.auth_token [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:16:31.142822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: WARNING keystonemiddleware.auth_token [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:16:31.472520 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:16:31.478490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: WARNING keystonemiddleware.auth_token [None req-87ed6965-c5ed-49d4-95f4-a5b0c12d6689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:16:31.484041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f001ad9c0 pid: 118331 (default app) Jun 24 04:16:31.494816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: WARNING keystonemiddleware.auth_token [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 04:16:31.501651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: WARNING keystonemiddleware.auth_token [None req-36e58f99-49a1-4d27-8aec-f43ee5076ac5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 04:16:31.506965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f001ad9c0 pid: 118330 (default app) Jun 24 04:17:10.869247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:10.870337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:10.871152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:10.871875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:12.328328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1ffe8463-4117-4ed0-b106-10508e85e2ef tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Action: 'create', calling method: .version_select at 0x7fdfef25a790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-240049509", "metadata": {"Type": "work"}}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1ffe8463-4117-4ed0-b106-10508e85e2ef tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 121 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:17:12.357471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-240049509", "metadata": {"Type": "work"}}} Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:17:12.360092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-240049509', 'metadata': {'Type': 'work'}}}} Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise error Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:12.361084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 04:17:12.362781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 04:17:12.364344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 04:17:12.364344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.366257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1ffe8463-4117-4ed0-b106-10508e85e2ef tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:12.367231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1ffe8463-4117-4ed0-b106-10508e85e2ef tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.510226 Jun 24 04:17:12.367912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jun 24 04:17:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1512 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:17:12.386685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=3 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:12.387528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=3 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:12.388485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=3 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:12.389246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=3 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:12.603444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-726fdc8a-444d-438c-a307-589d741ad7c5 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Action: 'create', calling method: .version_select at 0x7fdfef2ac280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685270951", "metadata": {"Type": "work"}}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-726fdc8a-444d-438c-a307-589d741ad7c5 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 120 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:17:12.604777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685270951", "metadata": {"Type": "work"}}} Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: Jun 24 04:17:12.606311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1685270951', 'metadata': {'Type': 'work'}}}} Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise error Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi '0' Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:12.607210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 04:17:12.608505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 04:17:12.609832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 04:17:12.609832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.609832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-726fdc8a-444d-438c-a307-589d741ad7c5 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:12.609832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-726fdc8a-444d-438c-a307-589d741ad7c5 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.225909 Jun 24 04:17:12.609832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jun 24 04:17:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:17:12.616555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be3574e4-0cc9-43f5-9314-5c88926c4874 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Action: 'create', calling method: .version_select at 0x7fdfef1d0a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623756554", "metadata": {"Type": "work"}}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be3574e4-0cc9-43f5-9314-5c88926c4874 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 119 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:17:12.619555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623756554", "metadata": {"Type": "work"}}} Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:17:12.621144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1623756554', 'metadata': {'Type': 'work'}}}} Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise error Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi '' Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:12.622080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 04:17:12.624710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 04:17:12.627646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 04:17:12.627646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:12.627646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-be3574e4-0cc9-43f5-9314-5c88926c4874 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:12.627646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-be3574e4-0cc9-43f5-9314-5c88926c4874 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009155 Jun 24 04:17:12.627646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jun 24 04:17:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:17:12.634822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d8e9b738-5210-41ae-a52e-7675887ab4e2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Calling method '.version_select at 0x7fdfefa888b0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:14.053335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-d8e9b738-5210-41ae-a52e-7675887ab4e2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] HTTP exception thrown: Volume tempest-invalid-1785411315 could not be found. Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d8e9b738-5210-41ae-a52e-7675887ab4e2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1785411315 HTTP/1.1 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:17:14.057572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Volume tempest-invalid-1785411315 could not be found. Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'tempest-invalid-1785411315'} Jun 24 04:17:14.059058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1785411315 could not be found. (HTTP 404) (Request-ID: req-180fc48d-cec2-423c-8b55-940177e0c5c3) Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.059825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:17:14.061141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1785411315 could not be found. Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:17:14.065081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1785411315 could not be found. Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1785411315 could not be found. Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d8e9b738-5210-41ae-a52e-7675887ab4e2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 404 to user: Volume tempest-invalid-1785411315 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d8e9b738-5210-41ae-a52e-7675887ab4e2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1785411315" status: 404 len: 99 microversion: 2.1 time: 1.430518 Jun 24 04:17:14.068329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jun 24 04:17:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1785411315 => generated 99 bytes in 1432 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 24 04:17:14.076853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06812deb-ff02-4a0c-9023-40690c89ecb0 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007040 Jun 24 04:17:14.078109 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jun 24 04:17:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 04:17:14.088455 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f674f7b6-c309-40f4-95e1-9b852e0bcdc2 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004748 Jun 24 04:17:14.089394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1136 bytes} [Fri Jun 24 04:17:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 04:17:14.099059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79cb5f92-1c6f-4e3f-9336-a4b47dcb6f3f tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Calling method '.version_select at 0x7fdfef25a700>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:14.687318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-79cb5f92-1c6f-4e3f-9336-a4b47dcb6f3f tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] HTTP exception thrown: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79cb5f92-1c6f-4e3f-9336-a4b47dcb6f3f tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/os-volumes/006bc471-779f-4bf9-83f9-f22cf20ff78a HTTP/1.1 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:17:14.690290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '006bc471-779f-4bf9-83f9-f22cf20ff78a'} Jun 24 04:17:14.691928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. (HTTP 404) (Request-ID: req-552eb0a4-dddc-425e-8396-d05e661dba43) Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.692894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:17:14.694315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 04:17:14.695640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. Jun 24 04:17:14.697001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.718210 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79cb5f92-1c6f-4e3f-9336-a4b47dcb6f3f tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 404 to user: Volume 006bc471-779f-4bf9-83f9-f22cf20ff78a could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:14.719088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-79cb5f92-1c6f-4e3f-9336-a4b47dcb6f3f tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/006bc471-779f-4bf9-83f9-f22cf20ff78a" status: 404 len: 109 microversion: 2.1 time: 0.623859 Jun 24 04:17:14.723843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:17:14 2022] DELETE /compute/v2.1/os-volumes/006bc471-779f-4bf9-83f9-f22cf20ff78a => generated 109 bytes in 629 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:17:14.734582 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f9d4d662-482f-4113-9613-b3dc42f2e949 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Calling method '.version_select at 0x7fdfef07fdc0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:14.957139 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-f9d4d662-482f-4113-9613-b3dc42f2e949 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] HTTP exception thrown: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f9d4d662-482f-4113-9613-b3dc42f2e949 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Request method failure captured: Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/os-volumes/9a836327-1d4d-4a9d-b8f9-347c328833cf HTTP/1.1 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrGGP_kSEjRLswC37sZW61ucYBKOfA-_Z76Na-jjtEuEAW-NDHMBtk1fsOaKeaInlsBoeuaGfOsSuw0MNdAnFSW30Ghqqi_VL00EmBPDApJj7cBRCEGFKZ_GDUarZDQThx8gkrNiGObzVM2fi8aOk87DRpjjfFIAlCBxjnYMMUBCP8 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:17:14.959138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf6ac8a37c564019bdad3a570e9241f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf6ac8a37c564019bdad3a570e9241f7"}]}] Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: cf6ac8a37c564019bdad3a570e9241f7 Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesNegativeTest-1871499352 Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b938baf805604bd9ab55d1c364daf426 Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesNegativeTest-1871499352-project Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '9a836327-1d4d-4a9d-b8f9-347c328833cf'} Jun 24 04:17:14.960567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. (HTTP 404) (Request-ID: req-dfb3d489-6ef2-4261-a9f3-bbbf4f8366eb) Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.961342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:17:14.963666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 04:17:14.965944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f9d4d662-482f-4113-9613-b3dc42f2e949 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] Returning 404 to user: Volume 9a836327-1d4d-4a9d-b8f9-347c328833cf could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:17:14.968979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f9d4d662-482f-4113-9613-b3dc42f2e949 tempest-VolumesNegativeTest-1871499352 tempest-VolumesNegativeTest-1871499352-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a836327-1d4d-4a9d-b8f9-347c328833cf" status: 404 len: 109 microversion: 2.1 time: 0.231176 Jun 24 04:17:14.971455 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:17:14 2022] GET /compute/v2.1/os-volumes/9a836327-1d4d-4a9d-b8f9-347c328833cf => generated 109 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:17:17.337046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1d9b4b05-9810-41ee-847c-4aa184bce5eb tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef903040>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:17.421757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1d9b4b05-9810-41ee-847c-4aa184bce5eb tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5817520f-3235-40d9-bb1d-83638bdde162" status: 200 len: 349 microversion: 2.1 time: 0.091099 Jun 24 04:17:17.422363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:17:17 2022] GET /compute/v2.1/os-volumes/5817520f-3235-40d9-bb1d-83638bdde162 => generated 349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:20.880466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c961015f-8323-440b-ad2a-034255900009 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0ae700>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:21.010033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c961015f-8323-440b-ad2a-034255900009 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/522fa4dd-d1ca-4a2a-ad1d-f335cbe512fa" status: 200 len: 351 microversion: 2.1 time: 0.138028 Jun 24 04:17:21.011092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:17:20 2022] GET /compute/v2.1/os-volumes/522fa4dd-d1ca-4a2a-ad1d-f335cbe512fa => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:23.691008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d466af1e-4ef9-48a0-bead-c3ec92dc5875 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0bb820>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:23.790638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d466af1e-4ef9-48a0-bead-c3ec92dc5875 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/087faaa1-1f16-4a5f-a296-da79b710cb93" status: 200 len: 350 microversion: 2.1 time: 0.104131 Jun 24 04:17:23.791630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:17:23 2022] GET /compute/v2.1/os-volumes/087faaa1-1f16-4a5f-a296-da79b710cb93 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:23.816133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4508e7b2-58d5-44ff-a8ba-0695b914423e tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0aedc0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:24.061093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4508e7b2-58d5-44ff-a8ba-0695b914423e tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.250302 Jun 24 04:17:24.061093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jun 24 04:17:23 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:24.071452 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ae2fe474-3069-40de-96d0-36485df5def7 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0bbe50>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:24.310006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ae2fe474-3069-40de-96d0-36485df5def7 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.246063 Jun 24 04:17:24.310799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1148 bytes} [Fri Jun 24 04:17:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:24.325038 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-acac11bc-78b2-489d-a1fa-4f540c36f310 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef07fe50>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:24.567827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-acac11bc-78b2-489d-a1fa-4f540c36f310 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.242910 Jun 24 04:17:24.567827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jun 24 04:17:24 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:24.576760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cb1f25c4-fd7e-4d77-8a6d-469400f73dea tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0bdaf0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:24.802761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cb1f25c4-fd7e-4d77-8a6d-469400f73dea tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230576 Jun 24 04:17:24.803803 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Jun 24 04:17:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:24.816978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fff3b928-82c2-4dcb-a5db-56782f449f8c tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0ae5e0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:25.048115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fff3b928-82c2-4dcb-a5db-56782f449f8c tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.236320 Jun 24 04:17:25.049462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Jun 24 04:17:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:25.063207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8bae596a-d97f-431e-9834-05d25efc25e7 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0bd820>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:25.242800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8bae596a-d97f-431e-9834-05d25efc25e7 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.185200 Jun 24 04:17:25.243987 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jun 24 04:17:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:25.257683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cd044894-75c1-43cf-8eca-037d235f23fa tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0b19d0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:25.471329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cd044894-75c1-43cf-8eca-037d235f23fa tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.218884 Jun 24 04:17:25.472253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1187 bytes} [Fri Jun 24 04:17:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:25.486133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0a403f5f-1331-4545-95db-7de60e798979 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] Calling method '.version_select at 0x7fdfef0bbe50>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:25.657625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0a403f5f-1331-4545-95db-7de60e798979 tempest-VolumesTestJSON-1635174670 tempest-VolumesTestJSON-1635174670-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.178069 Jun 24 04:17:25.658553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jun 24 04:17:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:28.820529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1087158489", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "networks": [{"uuid": "b4bf1515-2e35-410d-b83f-ccbbbbc60ef1"}]}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:29.144388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] validate_networks() for [('b4bf1515-2e35-410d-b83f-ccbbbbc60ef1', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:30.120700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a8c9f94c-ee74-4334-ac71-d59091b074b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: .version_select at 0x7fdfefa879d0>, body: {"keypair": {"name": "tempest-keypair-193457245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS4Snl5MSA0pqMO2sqUmGw1LGL1cuchmRyFLTjYvyBB9+TkKlnburl1yrB0Fuov7nT5Vopj/N1A5A4hpVojQri449zPR/Oh+i0PjPHOd9bk8ZB9Qcix8REOG7ZInacPWg=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:30.234900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-a8c9f94c-ee74-4334-ac71-d59091b074b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:30.255621 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-a8c9f94c-ee74-4334-ac71-d59091b074b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for user 9ffa029a3b1e4919b00e58a9737816d2 and project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:30.478696 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a8c9f94c-ee74-4334-ac71-d59091b074b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.671893 Jun 24 04:17:30.480795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 11/20] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Jun 24 04:17:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 675 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 04:17:31.269984 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9de8eae3-8aa8-408e-972b-9e695c024a9a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: .version_select at 0x7fdfef0bb9d0>, body: {"keypair": {"name": "tempest-keypair-133900604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9hD7hBVlGKjP7pW12IBQbvHxcBdtLmBOwtuWTc4YJ98Y/fxivAlbiBeLCxNlnfjEZ33c0OONl386uW4Rumi1+/wHowSV13eKUKjYiRPP/TcjA+J1/0ty9SLGY6c2GWw=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:31.291995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-9de8eae3-8aa8-408e-972b-9e695c024a9a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:31.297477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-9de8eae3-8aa8-408e-972b-9e695c024a9a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:31.439761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9de8eae3-8aa8-408e-972b-9e695c024a9a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.731698 Jun 24 04:17:31.451065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 12/21] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:17:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:17:34.288212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:34.289327 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:34.290114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:34.290700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:34.291274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:34.315748 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:34.316099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:34.321816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:34.322742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:34.387563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Getting quotas for project a48b90744f124a21b9e8d2b78836462e. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:34.395299 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Getting quotas for user aa8237a791034b80973d5cc4329d015c and project a48b90744f124a21b9e8d2b78836462e. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:34.411637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:34.415190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:34.635857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0a72c7b0-3ebb-4afe-a78f-75def8c940dc tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.158201 Jun 24 04:17:34.645514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 10/22] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 6162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:17:34.653482 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a9fd2a25-00e4-4601-ba6b-ec237dffe193 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:34.653880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a9fd2a25-00e4-4601-ba6b-ec237dffe193 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:34.915664 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9fd2a25-00e4-4601-ba6b-ec237dffe193 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:34.934252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a9fd2a25-00e4-4601-ba6b-ec237dffe193 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1215 microversion: 2.1 time: 0.287132 Jun 24 04:17:34.934860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:34 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:35.959422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2e82af96-55d4-492b-b79d-65d19af37f14 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:35.959422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2e82af96-55d4-492b-b79d-65d19af37f14 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:36.089847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-803663491", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:36.133585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2e82af96-55d4-492b-b79d-65d19af37f14 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:36.144813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2e82af96-55d4-492b-b79d-65d19af37f14 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1215 microversion: 2.1 time: 0.196251 Jun 24 04:17:36.145151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 14/24] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:35 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:36.262358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] validate_networks() for [('8ce8156e-f527-45c8-b424-190ecb88e595', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:36.455195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d81fabe8-9f9c-4e6d-be1a-5717d54c1614 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: .version_select at 0x7fdfee7d3d30>, body: {"keypair": {"name": "tempest-keypair-1125652823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI7tBzYwr+oyqbDdUb8hjhC6ElMSJIW9hSvSKUm11+qmdvQEDN6BIMEp84Q8aZ5twb9Dv9puOZ/uj/VEgQuJVRown5Pw2mEDtvXjT60pH0TMEUV74ijapBpy3OcqPxXtg=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:36.481576 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-d81fabe8-9f9c-4e6d-be1a-5717d54c1614 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:36.489464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-d81fabe8-9f9c-4e6d-be1a-5717d54c1614 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for user 066d1521db464b4996f6daf6548dcc38 and project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:36.598188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d81fabe8-9f9c-4e6d-be1a-5717d54c1614 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.410610 Jun 24 04:17:36.599306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 15/25] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:17:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:36.628989 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-534216612", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1499097c-b20d-4670-a290-7c6daddf6fa9"}], "security_groups": [{"name": "tempest-securitygroup--1108212974"}], "key_name": "tempest-keypair-193457245", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:36.988908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] validate_networks() for [('1499097c-b20d-4670-a290-7c6daddf6fa9', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:38.369770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:38.370230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:38.370980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:38.371356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:38.371771 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:38.409905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.418563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.418563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.418563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.453820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:38.459945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for user b158078d039a4979a9c0cf2be26c4b14 and project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:38.489553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:38.492097 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:38.533533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:38.533533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:38.533533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:38.533533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:38.533533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:38.538044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.538538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.539335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.539796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.567799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:38.572673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for user 9ffa029a3b1e4919b00e58a9737816d2 and project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:38.587627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:38.592922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:38.726101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-43837c24-cdb9-4d40-a842-cbc1ce077ce7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.190757 Jun 24 04:17:38.728738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 11/26] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:17:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:17:38.753192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:38.754400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:38.780708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.781865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.782935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:38.783590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:38.895821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ccfab037-7b00-46fa-9a17-c81e9ad70b27 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.295141 Jun 24 04:17:38.899225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 16/27] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jun 24 04:17:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 04:17:38.927275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bf8d37fd-3ee1-46af-a44b-7feccf453bda tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:38.931367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bf8d37fd-3ee1-46af-a44b-7feccf453bda tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:39.155302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf8d37fd-3ee1-46af-a44b-7feccf453bda tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:39.165363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bf8d37fd-3ee1-46af-a44b-7feccf453bda tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1221 microversion: 2.1 time: 0.263477 Jun 24 04:17:39.165640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 17/28] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:38 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:39.219852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:39.227745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:39.599760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:39.602860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:39.618455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:39.621997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dbf78801-9138-478c-ab6d-5975ce62c2a3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1280 microversion: 2.20 time: 0.455373 Jun 24 04:17:39.643165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 18/29] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:39 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:39.677961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622629746", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:39.729688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:39.784740 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-251b03fb-7fa3-4b81-950a-bd7724b4e7c6 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1211 microversion: 2.1 time: 1.050344 Jun 24 04:17:39.785905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 12/30] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:38 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1211 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:39.861004 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] validate_networks() for [('8ce8156e-f527-45c8-b424-190ecb88e595', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:40.643695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:40.644215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:40.887434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:40.918326 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:40.922241 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:40.932888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1ad40448-336a-4d89-a808-30f8705c0975 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1280 microversion: 2.20 time: 0.286945 Jun 24 04:17:40.932888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 13/31] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:40 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:17:40.941612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:40.943186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:40.964871 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:40.968226 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:40.969317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:40.970906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:41.200568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:41.212516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-791aef4d-5368-4d14-ab29-bfe1eb48a6ef tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1285 microversion: 2.1 time: 0.281771 Jun 24 04:17:41.215347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 14/32] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:40 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:41.235931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-935231951", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7"}], "security_groups": [{"name": "tempest-securitygroup--520290339"}], "key_name": "tempest-keypair-133900604", "user_data": "}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:41.713703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] validate_networks() for [('a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:42.337773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:42.346921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:42.348673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:42.349300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:42.350230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:42.378255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:42.379980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:42.398478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:42.398478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:42.476812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:42.488947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for user b158078d039a4979a9c0cf2be26c4b14 and project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:42.549879 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:42.557800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:42.837084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7a5bbbc2-7e19-466e-8bff-76cfc90d3753 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.192656 Jun 24 04:17:42.838322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 19/33] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:17:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:17:42.849506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:42.852243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:42.876335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:42.876791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:42.877571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:42.878006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:43.246042 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:43.266651 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:43.268298 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:43.269514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1a611441-d2b6-419f-9b0f-7f88c8f6edf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1340 microversion: 2.20 time: 0.423972 Jun 24 04:17:43.270152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 20/34] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:42 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1340 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:43.277909 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:43.278830 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:43.286234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:43.286790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:43.287631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:43.288138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:43.457203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:43.474140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c4cae36c-c278-484a-9dba-28dddeeceea8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1273 microversion: 2.1 time: 0.194383 Jun 24 04:17:43.476283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 21/35] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:43 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:43.487841 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-81c83166-ed44-40c8-86bf-76dfa7fafef2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:43.495160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-81c83166-ed44-40c8-86bf-76dfa7fafef2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:43.632221 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-81c83166-ed44-40c8-86bf-76dfa7fafef2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:43.645756 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-81c83166-ed44-40c8-86bf-76dfa7fafef2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1221 microversion: 2.1 time: 0.168165 Jun 24 04:17:43.647179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 22/36] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:43 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:43.652758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-988241592", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7b2c59a-0555-4ea1-82f3-82731a83d232"}], "security_groups": [{"name": "tempest-securitygroup--978920591"}], "key_name": "tempest-keypair-1125652823", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:43.690998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:43.691523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:43.691866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:43.692275 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:43.692682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:43.703597 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:43.704046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:43.704827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:43.705416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:43.755748 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:43.771024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:43.789593 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:43.793103 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:43.974607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-460505c0-0ceb-44f6-837c-76c79ec2f54a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.757920 Jun 24 04:17:43.975750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 15/37] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:17:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:17:43.993013 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ba54e157-9e8b-42c7-a884-03aa37a9706e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:43.994123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ba54e157-9e8b-42c7-a884-03aa37a9706e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:44.065156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] validate_networks() for [('e7b2c59a-0555-4ea1-82f3-82731a83d232', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:17:44.120336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ba54e157-9e8b-42c7-a884-03aa37a9706e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:44.133867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ba54e157-9e8b-42c7-a884-03aa37a9706e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1240 microversion: 2.1 time: 0.144258 Jun 24 04:17:44.133867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 16/38] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:43 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:44.288602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:44.296496 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:44.306706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.307161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.307957 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.308388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.433602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:44.451860 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:44.453404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:44.454603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1d218fc3-1fc7-4431-b1b6-97d7f9e84b11 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1350 microversion: 2.20 time: 0.169836 Jun 24 04:17:44.455511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 17/39] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:44 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:44.497529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:44.498752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:44.514972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.515670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.516611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.517198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.829347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:44.841179 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-aa0564a6-5225-42f7-a963-4dbd8f1d70a3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.348759 Jun 24 04:17:44.844271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 18/40] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:44 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:17:44.849295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:44.858090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:44.871320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.874574 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.875669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:44.876298 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:44.996089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:17:45.001577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:17:45.002877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:17:45.004520 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:17:45.006772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:17:45.016321 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:45.027414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.027870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:45.028673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.030108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:45.056919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:17:45.058415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.061526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for user 066d1521db464b4996f6daf6548dcc38 and project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:17:45.071008 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-252117d6-3a21-4b85-9b8e-25c9110cd873 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1225 microversion: 2.1 time: 0.225265 Jun 24 04:17:45.075584 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:17:45.078916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:17:45.084706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 19/41] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:44 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1225 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:45.158656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eac2a407-e320-4b8f-9b98-277b061c57ab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:45.159210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-eac2a407-e320-4b8f-9b98-277b061c57ab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:45.243703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-618083a3-87e7-4e83-971a-c301b092cb52 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.595291 Jun 24 04:17:45.245215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 23/42] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:17:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:17:45.256427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45e08c60-29d6-49a8-ab59-83c29a83749b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:45.257369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45e08c60-29d6-49a8-ab59-83c29a83749b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:45.337931 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45e08c60-29d6-49a8-ab59-83c29a83749b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.345992 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45e08c60-29d6-49a8-ab59-83c29a83749b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1237 microversion: 2.1 time: 0.093395 Jun 24 04:17:45.347534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:45 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:45.478830 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:45.479541 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:45.486465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.487004 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:45.490158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-eac2a407-e320-4b8f-9b98-277b061c57ab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.494488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.495027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:45.507675 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-eac2a407-e320-4b8f-9b98-277b061c57ab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1240 microversion: 2.1 time: 0.362114 Jun 24 04:17:45.510558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 20/44] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:45 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1240 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:17:45.580073 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.594192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.595959 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:45.597734 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cf9861e4-a6e4-4ca6-9745-41ab32a59b34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1350 microversion: 2.20 time: 0.122726 Jun 24 04:17:45.610774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 25/45] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:45 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:45.866615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:45.867230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:45.877753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.878205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:45.879342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:45.879947 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.097486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.100137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:46.110128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:46.116307 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-962c8ac9-aa68-4db8-8012-fddae874a021 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.252048 Jun 24 04:17:46.127944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 21/46] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:45 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:46.131805 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.134620 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.146789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.146789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.242248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.262088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c1b7d8e-4544-4a2d-901a-d4f540aae209 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1225 microversion: 2.1 time: 0.177120 Jun 24 04:17:46.263489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 26/47] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:46 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:46.364088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5fcf1d78-3c7f-4f20-b190-9b38b42c54d5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:46.365324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5fcf1d78-3c7f-4f20-b190-9b38b42c54d5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:46.510346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5fcf1d78-3c7f-4f20-b190-9b38b42c54d5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.519873 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5fcf1d78-3c7f-4f20-b190-9b38b42c54d5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1237 microversion: 2.1 time: 0.160086 Jun 24 04:17:46.524459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:46 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1237 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:46.528102 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:46.528838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:46.553165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.553745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.559405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.559405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.618505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:46.619858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:46.633729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.634548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.637564 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:46.638289 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:46.727260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.737497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a9bc8c75-ca65-4988-873f-ce1e3a7e35d1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1244 microversion: 2.1 time: 0.214667 Jun 24 04:17:46.751150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 27/49] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:46 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1244 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:46.888525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.903552 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.906435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:46.921386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-76bc3a47-759a-41f5-92c2-4b104de0d8f2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1350 microversion: 2.20 time: 0.307716 Jun 24 04:17:46.923749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 23/50] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:46 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1350 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:17:47.155421 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:47.161067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:47.231744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.238479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:47.241295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.246957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:47.282193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:47.282958 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:47.302857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.312729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:47.316942 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.319756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:47.812451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:47.834147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a33ed7c2-d0a5-4d42-9395-5e9cceca1e0a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.700729 Jun 24 04:17:47.834938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 28/51] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:47 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:47.847388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:47.855279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:47.865317 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.871630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:47.871630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:47.880138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.058473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.071293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.074596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3ceb8a32-244a-4778-87df-6da11e82e3c7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1273 microversion: 2.1 time: 0.798346 Jun 24 04:17:48.077651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 24/52] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:47 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1273 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:17:48.096367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-18f24e96-91c4-42e3-b0ff-62a0ac182836 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1233 microversion: 2.1 time: 0.259023 Jun 24 04:17:48.108429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 29/53] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:47 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1233 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:48.108761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:48.108761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:48.109024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:48.109024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:48.116777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.117323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.118912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.123706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.124860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.125591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.130070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.130070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.271008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.280627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.292456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.293955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0be9569a-dd0f-4ec5-a135-6cc8fb69bf6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1338 microversion: 2.20 time: 0.195952 Jun 24 04:17:48.297698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 30/54] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:48 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:48.335709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:48.346483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a1cb62e3-458b-463e-8533-61d5ff637ff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1292 microversion: 2.1 time: 0.265753 Jun 24 04:17:48.350757 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 25/55] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:48 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:48.865723 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:48.866787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:48.877030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.880046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:48.881265 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:48.882108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.103986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:49.105357 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:49.134766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.140810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.150941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.152913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.618138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:49.628343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b6b39b6e-d7fe-4629-99a0-b73ac7f98e6e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1281 microversion: 2.1 time: 0.534976 Jun 24 04:17:49.634561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 26/56] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:49 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1281 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:49.648354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:49.649200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:49.661529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.662252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.664835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.665430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.860592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:49.878989 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-125d5829-3f79-4d03-ad5a-9e8f8e4c05b5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1297 microversion: 2.1 time: 0.242973 Jun 24 04:17:49.879657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 27/57] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:49 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1297 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:49.893495 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:49.894344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:49.902045 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.918913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:49.920553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:49.921317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.106458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:50.120656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:50.124134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:50.125688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ea87f83f-9739-46b6-9d38-2107462d8844 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1338 microversion: 2.20 time: 0.244861 Jun 24 04:17:50.126462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 28/58] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:49 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:50.133703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:50.134644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:50.147602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.150032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.150032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.150032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.302004 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:50.315898 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-03c7992c-a0c3-45ac-af5b-60568044967e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 1.465653 Jun 24 04:17:50.327188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:48 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:50.372829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:50.385481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-935bbccd-bc6f-44c5-86fe-61875b2a7f65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1298 microversion: 2.1 time: 0.253126 Jun 24 04:17:50.386113 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 29/60] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:50 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:50.407429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-52cb53b4-21b6-4cb2-934c-c730861ffb73 req-a5993354-7425-4e52-adbe-239849010506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f16fc0-cce2-4425-b19e-3d48d212e9be", "tag": "9db12867-7f3c-4aed-ab68-f4fff1b4247b"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:50.418875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-52cb53b4-21b6-4cb2-934c-c730861ffb73 req-a5993354-7425-4e52-adbe-239849010506 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.419356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-52cb53b4-21b6-4cb2-934c-c730861ffb73 req-a5993354-7425-4e52-adbe-239849010506 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.442033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-52cb53b4-21b6-4cb2-934c-c730861ffb73 req-a5993354-7425-4e52-adbe-239849010506 service nova] Creating event network-changed:9db12867-7f3c-4aed-ab68-f4fff1b4247b for instance 01f16fc0-cce2-4425-b19e-3d48d212e9be on hv-cinder-84684 Jun 24 04:17:50.443006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-52cb53b4-21b6-4cb2-934c-c730861ffb73 req-a5993354-7425-4e52-adbe-239849010506 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 04:17:50.444552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.445361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.446508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.447173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.461961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.compute.rpcapi [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 04:17:50.461961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] Releasing lock "compute-rpcapi-router" {{(pid=118331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 04:17:50.476655 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-baf66cef-439c-4565-9bd5-6c3e73abe53b None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147761 Jun 24 04:17:50.477993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 32/61] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:50.651484 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:50.652405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:50.659456 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.660468 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.661737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.662428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.901747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:50.905014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:50.932426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.938740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:50.938740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:50.938740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.149438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:51.195264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-66045b1a-9975-439b-9155-0215f3d942ff tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1279 microversion: 2.1 time: 0.541593 Jun 24 04:17:51.198753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 30/62] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:50 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1279 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:51.220359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:51.223436 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:51.249039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:51.261785 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.275711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.276092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d76c3b99-8c58-4c0c-bf8b-d6c8c4d4b872 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1295 microversion: 2.1 time: 0.370381 Jun 24 04:17:51.276177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.276177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.288231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:50 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1295 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:51.337911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:51.345602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:51.363957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.376111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.382112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.386438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.817554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:51.831813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-62e45e91-aa28-480f-b3d0-c12f23e852b8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.501981 Jun 24 04:17:51.848983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 34/64] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:51 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:17:51.853955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:51.854798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:51.862490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.863178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:51.864105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:51.864678 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.036749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.081477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.086580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.095841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e774b930-5403-44fd-b5e5-a2a9a00d53ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.895666 Jun 24 04:17:52.096555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 31/65] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:51 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:52.139196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.151601 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0942632f-a49d-4832-8734-9a15f062ded5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1298 microversion: 2.1 time: 0.299269 Jun 24 04:17:52.152729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:51 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1298 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:52.213333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:52.214233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:52.236155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.236602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.237388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.237820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.283323 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:52.283524 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:52.294497 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:52.305954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.311103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.314653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.315262 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.677369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.691935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ca189c43-4fa0-4749-9abc-8aa29cc070fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1279 microversion: 2.1 time: 0.481173 Jun 24 04:17:52.695101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 32/67] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:52 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1279 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:52.776213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:52.795614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-907bf412-57d8-4d33-9580-a6e99e006956 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1295 microversion: 2.1 time: 0.515312 Jun 24 04:17:52.799683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 36/68] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:52 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1295 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:52.853198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:52.854043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:52.856882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:52.863785 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.864234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:52.869113 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:52.871002 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.114613 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:53.115538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:53.128768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.129628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.130704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.131290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.712588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:53.714800 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=6 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:53.722635 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-44e713d3-28a8-44ff-a7aa-c75dc206ae1c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.873256 Jun 24 04:17:53.723225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 33/69] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:52 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:17:53.738305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:53.739698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:53.754867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.756851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.760521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.761287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.818149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:53.834301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:53.837160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:53.839437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5cfdfb31-e65c-485e-ab9c-5941e0744ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.728706 Jun 24 04:17:53.853219 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 37/70] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:53 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:53.864616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:53.865640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:53.873977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.874461 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:53.875427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:53.876001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.265973 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:54.276041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:54.283743 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-599a4b8c-8e4a-4823-8b45-e40b7abe675e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.419259 Jun 24 04:17:54.284964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 38/71] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:53 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:54.297153 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:54.297695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:54.305128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.305778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.306766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.308161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.732971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:54.742939 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9014f740-e30a-4b5b-9d49-50165cb859f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1295 microversion: 2.1 time: 0.456645 Jun 24 04:17:54.762642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 39/72] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:54 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1295 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:54.765742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:54.766633 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:54.778626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.779966 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.782164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.783687 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:54.784527 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.801997 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0d5b3c04-8bc8-49db-80a2-6e6f2f157ede tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 1.077681 Jun 24 04:17:54.803774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 34/73] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:53 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:54.860671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:54.861983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:54.881262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.881262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:54.886606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:54.887170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:55.342315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:55.344862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=42 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:55.353965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-12d2aa37-6f46-49b7-ba0a-111bf7c96910 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.593233 Jun 24 04:17:55.359218 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:54 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:55.368961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:55.374162 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:55.413166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:55.413805 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:55.426763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:55.427342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:55.756904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:55.779366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:55.781537 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:55.782755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a4a44bfb-c39e-41ea-b625-f908129af474 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.926218 Jun 24 04:17:55.800977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 35/75] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:54 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:17:55.809639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:55.811463 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:55.830482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:55.830482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:55.830482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:55.830835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.406967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:56.426991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-82f4e3e7-b556-41d0-8768-02e87615b067 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 1.066129 Jun 24 04:17:56.427650 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 41/76] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:55 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:56.432323 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:56.433109 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:56.452203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.452651 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.464057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.464768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.519533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=26 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:17:56.676964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:56.687629 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-61094fac-4c3f-4b81-8545-68e818337119 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.883685 Jun 24 04:17:56.688459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:55 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:56.698597 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-90ddcf2d-9bb8-4e2e-a326-b842c0f110ab req-1927a4cd-8e73-427b-abbe-e2a17f55d6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570", "tag": "9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:56.726391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-90ddcf2d-9bb8-4e2e-a326-b842c0f110ab req-1927a4cd-8e73-427b-abbe-e2a17f55d6ca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.727127 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-90ddcf2d-9bb8-4e2e-a326-b842c0f110ab req-1927a4cd-8e73-427b-abbe-e2a17f55d6ca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.795302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-90ddcf2d-9bb8-4e2e-a326-b842c0f110ab req-1927a4cd-8e73-427b-abbe-e2a17f55d6ca service nova] Creating event network-changed:9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a for instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 on hv-cinder-84684 Jun 24 04:17:56.798647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-90ddcf2d-9bb8-4e2e-a326-b842c0f110ab req-1927a4cd-8e73-427b-abbe-e2a17f55d6ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=118330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 04:17:56.800203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.801696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.803407 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.804053 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.817156 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.compute.rpcapi [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 04:17:56.828372 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] Releasing lock "compute-rpcapi-router" {{(pid=118330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 04:17:56.863799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d8e7db2e-b417-40e7-a826-f05a675597cc None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163832 Jun 24 04:17:56.863799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 37/78] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:56.863799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:56.863799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:56.870747 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.871267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:56.872206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:56.873085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:57.108988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:57.118443 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0c1c1118-7d27-4991-b2c1-cb0ad32aa1b7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.689676 Jun 24 04:17:57.120758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 42/79] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:56 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:57.142481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:57.146105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:57.163971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:57.173038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:57.175011 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:57.175972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:57.472179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:57.483958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:57.486084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:57.487620 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-69f5fdc5-b37c-4e5e-81ff-62fe792df1bf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.353282 Jun 24 04:17:57.488420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 43/80] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:57 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:57.493829 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:57.501253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:57.502213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:57.502894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:57.503875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:57.504516 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:57.925068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:57.947450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e2665e4f-63ad-45c9-8425-5307bf0aa763 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.457687 Jun 24 04:17:57.959131 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 44/81] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:57 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:57.979780 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:57.980589 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:57.996164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:57.996916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:58.003451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:58.004154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:58.284591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:58.310770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-438aa432-9cce-4088-8251-00177657c155 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 1.447639 Jun 24 04:17:58.311427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 38/82] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:56 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:58.323728 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:58.324413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:58.378390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:58.381858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:58.384946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:58.385406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:58.805965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:58.816613 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f6b71940-653c-424a-be82-a7708212abc5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.840584 Jun 24 04:17:58.826398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 45/83] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:57 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:58.847992 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:58.853194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:58.877408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:58.879414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:58.881376 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:58.882866 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.489367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:59.532189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:59.536183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:59.543078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a4c0edc0-9255-4e1b-82a1-2f3012166373 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.712229 Jun 24 04:17:59.544862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 46/84] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:17:58 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:17:59.599887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:17:59.632994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e4122af5-5e66-4ac0-89fe-cfd7010c6c7f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 1.315089 Jun 24 04:17:59.635211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 39/85] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:58 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:17:59.642410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-c71ca202-b008-4356-9626-1d877230a844 req-792e2d97-02fb-4845-84d8-766537d5f40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734155da-ee09-4da7-aa56-2c506b7ed2cd", "tag": "15680038-79e1-44d0-bf98-1d22ed996825"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:59.673172 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c71ca202-b008-4356-9626-1d877230a844 req-792e2d97-02fb-4845-84d8-766537d5f40c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.674825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c71ca202-b008-4356-9626-1d877230a844 req-792e2d97-02fb-4845-84d8-766537d5f40c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.720447 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-c71ca202-b008-4356-9626-1d877230a844 req-792e2d97-02fb-4845-84d8-766537d5f40c service nova] Creating event network-changed:15680038-79e1-44d0-bf98-1d22ed996825 for instance 734155da-ee09-4da7-aa56-2c506b7ed2cd on hv-cinder-84684 Jun 24 04:17:59.727439 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-c71ca202-b008-4356-9626-1d877230a844 req-792e2d97-02fb-4845-84d8-766537d5f40c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090297 Jun 24 04:17:59.728637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 40/86] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:59.738722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:59.740184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:59.751498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.752265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.753244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.753859 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.807152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-9461f145-9bea-43e3-9fff-6ba69ace8a4c req-a811b656-2f22-44c7-bffc-f37d57f715d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:17:59.826420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-9461f145-9bea-43e3-9fff-6ba69ace8a4c req-a811b656-2f22-44c7-bffc-f37d57f715d6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.827628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-9461f145-9bea-43e3-9fff-6ba69ace8a4c req-a811b656-2f22-44c7-bffc-f37d57f715d6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.855731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-9461f145-9bea-43e3-9fff-6ba69ace8a4c req-a811b656-2f22-44c7-bffc-f37d57f715d6 service nova] Creating event network-changed:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:17:59.862174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-9461f145-9bea-43e3-9fff-6ba69ace8a4c req-a811b656-2f22-44c7-bffc-f37d57f715d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315720 Jun 24 04:17:59.863088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 47/87] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:17:59.875969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:17:59.877907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:17:59.887979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.888765 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:17:59.890012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:17:59.890648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.168677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.176749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c950870e-9ab8-467b-9c6d-2d28db5b842b tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.312140 Jun 24 04:18:00.177541 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 48/88] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:59 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:00.183563 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:00.184368 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:00.191133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.191810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.192590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.193032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.238564 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.246429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-91a7cdee-2dbe-4587-8137-150047b4a54e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.516167 Jun 24 04:18:00.247007 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 41/89] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:17:59 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:00.424083 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.437240 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dcbf3155-64f7-410a-9ddd-6d600edb3b24 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.258275 Jun 24 04:18:00.439522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 49/90] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:00 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:00.563607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:00.564217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:00.572972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.573419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.574193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.582906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.652894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:00.653947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:00.656296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:00.663840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.664432 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.665379 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:00.666038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:00.819387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.827908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-edff580b-eafb-4c93-8a5c-4ace8b1efebd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.179242 Jun 24 04:18:00.828608 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 50/91] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:00 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:00.971542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.989658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.991179 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:00.998796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-35ee5b9b-4de4-4df0-b37c-1f08406d5d90 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.439728 Jun 24 04:18:00.999633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 42/92] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:00 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:01.194875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:01.196093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:01.210334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.211216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.213167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.213675 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.264810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:01.265786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:01.272718 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.273452 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.274226 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.274682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.369040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:01.376888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fa05dfcc-e61c-4c46-a387-71e4f1c99889 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.186445 Jun 24 04:18:01.377870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 51/93] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:01 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:01.427723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:01.435214 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3d56397c-dce6-494b-9763-e0759e90cd25 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.175046 Jun 24 04:18:01.435804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 43/94] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:01 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:01.455393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:01.456003 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:01.462231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.464276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.464276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.464276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.598294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:01.605689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6695cb25-776d-4c47-9550-af53458a1375 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.154085 Jun 24 04:18:01.606190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 52/95] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:01 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:01.845961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:01.846604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:01.852543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.855634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.855634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.855634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.928462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab22e349-8bc5-4678-979e-0db7dfcfdb29", "tag": "628c6256-3f93-415e-8d57-183e79f02abb"}, {"name": "network-changed", "server_uuid": "95960fad-f7dd-4195-97e2-b8519a0ac2d3", "tag": "743a00dc-b28e-4621-9d5a-757c991d77fb"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:01.939133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:01.939866 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:01.954219 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] Creating event network-changed:628c6256-3f93-415e-8d57-183e79f02abb for instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 on hv-cinder-84684 Jun 24 04:18:01.955075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] Creating event network-changed:743a00dc-b28e-4621-9d5a-757c991d77fb for instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 on hv-cinder-84684 Jun 24 04:18:01.963124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-3671ca3c-b625-43f8-9980-f4131cd087e6 req-20095e87-f057-49c7-9b62-550ea4c1460a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039317 Jun 24 04:18:01.966126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 53/96] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:02.000667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.008117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5b102aef-2cd0-4f71-aab5-d56646d38699 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.166897 Jun 24 04:18:02.012100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 44/97] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:01 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:02.024614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:02.025415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:02.039390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.039390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.039390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.039390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.172251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.180544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.182039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.183159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e4c982f-7afa-4aa1-8312-3474e6ce3727 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.163066 Jun 24 04:18:02.183717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 54/98] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:02 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:02.394622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:02.394622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:02.400581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.401016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.401861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.402292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.453691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:02.454399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:02.462066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.462548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.464228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.468152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.538402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.546780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-608e7520-8656-4c68-b0b0-ca4fc28b92b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.157148 Jun 24 04:18:02.547342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 45/99] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:02 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:02.602882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.611024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d0042353-45ee-456f-8deb-1f120615060c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.162790 Jun 24 04:18:02.611669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:02 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:02.624015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:02.629354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:02.632656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.633111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.633913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:02.634331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:02.771060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:02.782763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-852fa7f8-c245-4018-beaa-929e3f7576ad tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.163604 Jun 24 04:18:02.783539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:02 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:03.025399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:03.026010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:03.032279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.032723 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.033486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.033918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.163345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.167040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:03.172261 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7c3b6492-c348-41fe-baec-498d6c601689 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.150973 Jun 24 04:18:03.174820 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 56/102] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:03 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:03.203870 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:03.203870 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:03.208780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.209433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.210411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.210994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.355944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.364043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.365472 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.366601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9c4440d2-d328-4221-bba5-53d17f6e5f47 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.168950 Jun 24 04:18:03.367151 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 47/103] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:03 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:03.565622 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:03.566226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:03.572266 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.572708 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.573473 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.573880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.628995 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:03.629615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:03.635601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.636048 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.636786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.637209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.711096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.732708 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9800e44e-5bd1-458c-bdaf-aecce7b3592e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.167510 Jun 24 04:18:03.735656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:03 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:03.784323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.791798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b7b795b4-50ee-45c5-8213-09a49883be0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.166603 Jun 24 04:18:03.798228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:03 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:03.799748 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:03.800368 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:03.806865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.807314 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.808074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:03.808507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:03.935350 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:03.942677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-01f633ea-5639-4913-84aa-6efbaae006c4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.146822 Jun 24 04:18:03.943243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 58/106] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:03 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:04.189136 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:04.189710 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:04.196216 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.196660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.197413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.197844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.328731 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.336182 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9b8db6ca-88c6-438f-9900-b8e41db08929 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.150991 Jun 24 04:18:04.336735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:04 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:04.384875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:04.385481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:04.391709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.392152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.392906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.393341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.521178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.529325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.530896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.532034 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8d31c4a0-a7e3-4f0b-b782-a851824cf045 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.151099 Jun 24 04:18:04.532671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 59/108] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:04 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:04.752986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:04.753609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:04.760062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.760581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.761478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.761920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.767037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:04.808757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:04.809367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:04.819810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.820309 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.824081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.824081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.916802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.924567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d0166e55-a9f1-402c-a590-13ad4de645a7 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.177818 Jun 24 04:18:04.933671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 50/109] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:04 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:04.961749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:04.962484 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:04.964799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:04.970850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.971518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.972349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:04.972935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:04.973774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9ea33dea-40fe-4d5b-9ef6-f0055f81ff4e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.168731 Jun 24 04:18:04.974363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 60/110] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:04 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:05.108569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:05.116663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-faba49a0-6c56-4e0d-a86b-287712e43e23 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.160090 Jun 24 04:18:05.118989 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:04 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:05.353036 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:05.353679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:05.359689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.360154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.360919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.361353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.489818 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:05.497188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-39767bf6-a9cd-41e7-b229-1bb526af362c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.148036 Jun 24 04:18:05.498348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 61/112] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:05 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:05.550472 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:05.551070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:05.557266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.557656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.558496 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.558962 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.691089 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:05.698795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:05.700824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:05.702024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c3096519-84c8-43d3-8f38-1b89fffe0cd4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.155586 Jun 24 04:18:05.702611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 52/113] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:05 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:05.941147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:05.941749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:05.947818 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.948296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.949047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.949473 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.991338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:05.991945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:05.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:05.999090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:05.999851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.000284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.084526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.092940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a66af627-d1f9-4087-8219-6a7f0209cd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.155529 Jun 24 04:18:06.094412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 62/114] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:05 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:06.133325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:06.134651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.134811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:06.140427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.141202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.141761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1dc015e7-7ce1-4f9b-b981-9e694e45a9a1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.154355 Jun 24 04:18:06.142154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.142859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.142988 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 53/115] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:05 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:06.286502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.294171 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f6f26b3f-8c09-4bea-b287-25bd348e18e0 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.164796 Jun 24 04:18:06.294759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:06 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:06.514558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:06.515164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:06.521176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.521882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.522659 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.523093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.653205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.661065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-eb067b8a-76f2-489f-adc8-437575d7718d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.150369 Jun 24 04:18:06.661655 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 54/117] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:06 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:06.720384 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:06.720988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:06.726923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.727375 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.728131 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:06.728595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:06.865335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.888845 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.890948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:06.892101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ba211107-c37b-4397-b9d9-b6b073f5749d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.176301 Jun 24 04:18:06.892981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 64/118] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:06 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:07.109062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:07.109649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:07.111501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:07.116333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.116765 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.117504 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.117929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.159647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:07.160429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:07.167294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.167742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.168506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.169304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.264080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:07.282207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9ec05882-833b-444c-9d0f-a753cf3521e3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.177050 Jun 24 04:18:07.283134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 55/119] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:07 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:07.314530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:07.319138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:07.321849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.322293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.323114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.323542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.338319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:07.345899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6efb04af-2fbf-49bf-96b4-874a67f7862c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.190275 Jun 24 04:18:07.346479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:07 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:07.460930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:07.468810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-944fd860-4d0d-4a71-9294-91e4731c40c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.161427 Jun 24 04:18:07.470159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 56/121] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:07 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:07.677585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:07.678789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:07.681844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:07.685901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.686357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.687131 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.688169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.917890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:07.928607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:07.931807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:07.941910 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a4842cfe-0a66-49ab-ad7b-3faa407492fd tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.268155 Jun 24 04:18:07.942524 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 66/122] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:07 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:07.953081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.953081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:07.953081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:07.953081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.300634 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:08.301590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:08.308669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.309349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.310563 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.311039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.464502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:08.472874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c2da383c-3d8e-4200-86b7-e4a2063b9914 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.176236 Jun 24 04:18:08.474322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 67/123] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:08 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:08.479511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:08.480433 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:08.483411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:08.491104 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.491548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.492305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.492741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.497730 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:08.499360 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:08.500518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-12c64928-b3af-40f5-b30b-c060794e0a7b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.590764 Jun 24 04:18:08.501063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 57/124] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:07 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:18:08.511677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:08.512456 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:08.519598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.520278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.521269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.522117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.680019 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:08.692971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2ff43d5d-2b97-48cc-8c5f-4a0dd90d6f44 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.216413 Jun 24 04:18:08.694555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 68/125] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:08 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:08.861523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-772c77d4-9328-4390-a7e1-e1e4a5e457c1 req-a8f874e3-0c51-4479-bdf3-a9dedf0165e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570", "name": "network-vif-plugged", "status": "completed", "tag": "9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:08.869855 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-772c77d4-9328-4390-a7e1-e1e4a5e457c1 req-a8f874e3-0c51-4479-bdf3-a9dedf0165e0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.870299 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-772c77d4-9328-4390-a7e1-e1e4a5e457c1 req-a8f874e3-0c51-4479-bdf3-a9dedf0165e0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.883402 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-772c77d4-9328-4390-a7e1-e1e4a5e457c1 req-a8f874e3-0c51-4479-bdf3-a9dedf0165e0 service nova] Creating event network-vif-plugged:9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a for instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 on hv-cinder-84684 Jun 24 04:18:08.889289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-772c77d4-9328-4390-a7e1-e1e4a5e457c1 req-a8f874e3-0c51-4479-bdf3-a9dedf0165e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106061 Jun 24 04:18:08.890215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 69/126] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:18:08.960748 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:08.961762 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:08.979627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.986560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:08.986560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:08.986560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.158069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.168502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8b471f0f-b1f2-4b99-a3da-13100a9f4564 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.211675 Jun 24 04:18:09.170412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 70/127] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:08 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:09.238501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.246173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3485d03a-0e71-4f9c-8b52-865c171769e6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.741747 Jun 24 04:18:09.246776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 58/128] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:08 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:09.491018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:09.491834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:09.500619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.501259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.508807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.508807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.524560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:09.526598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:09.538604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.538604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.539389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.539824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.706707 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.711487 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.714977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.717372 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.718516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9a2f48be-431c-4be4-ad4e-c57216224c35 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.203034 Jun 24 04:18:09.719333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 59/129] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:09 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:18:09.720907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-555d819f-ad0c-43ef-86cb-d49230902179 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.233855 Jun 24 04:18:09.721507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 71/130] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:09 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:09.724043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:09.724638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:09.730513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.730948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.731958 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:09.732533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:09.875210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:09.882802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a047607f-28fb-4ad0-b1b4-7564bf1825f6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.162200 Jun 24 04:18:09.884858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 60/131] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:09 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:10.188067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:10.189463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:10.195096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.195653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.196416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.196843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.264238 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:10.264928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:10.273466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.274229 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.277766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.277766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.350304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:10.360821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2b5a2408-37a1-416c-ab51-eb49bb9c6fff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.176675 Jun 24 04:18:10.361404 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 72/132] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:10 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:10.733475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:10.738783 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:10.739689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:10.741141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-be243aef-d2c1-448d-afbc-3cddd4982644 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.481025 Jun 24 04:18:10.741705 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 61/133] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:10 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:10.754529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.754983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.755750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.756372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.757003 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:10.757835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:10.766859 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.768157 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.769183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.769680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.913438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:10.927231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e67e7c63-abbe-463c-bc4d-ca591b1b7e6c tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.193379 Jun 24 04:18:10.928255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 73/134] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:10 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:10.933645 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:10.936231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:10.947572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.948506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.960591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:10.961486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:10.969297 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:11.049470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.057552 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.059081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.065851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a8670f55-aa39-4660-916a-b18b06b27cf3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.318016 Jun 24 04:18:11.065851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 62/135] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:10 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:11.065851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-590abbed-05e5-4554-abc9-f94a5b4a9aa5 req-f47b55d4-7af0-420e-83f3-1a3b953fa8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f16fc0-cce2-4425-b19e-3d48d212e9be", "name": "network-vif-plugged", "status": "completed", "tag": "9db12867-7f3c-4aed-ab68-f4fff1b4247b"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:11.073870 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-590abbed-05e5-4554-abc9-f94a5b4a9aa5 req-f47b55d4-7af0-420e-83f3-1a3b953fa8c6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.074309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-590abbed-05e5-4554-abc9-f94a5b4a9aa5 req-f47b55d4-7af0-420e-83f3-1a3b953fa8c6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.086047 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-590abbed-05e5-4554-abc9-f94a5b4a9aa5 req-f47b55d4-7af0-420e-83f3-1a3b953fa8c6 service nova] Creating event network-vif-plugged:9db12867-7f3c-4aed-ab68-f4fff1b4247b for instance 01f16fc0-cce2-4425-b19e-3d48d212e9be on hv-cinder-84684 Jun 24 04:18:11.091814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-590abbed-05e5-4554-abc9-f94a5b4a9aa5 req-f47b55d4-7af0-420e-83f3-1a3b953fa8c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028702 Jun 24 04:18:11.092406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 63/136] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:11.128979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.136421 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-83589a58-17c2-4ca8-af7f-d365811eb737 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.206873 Jun 24 04:18:11.136980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 74/137] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:10 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:11.378120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:11.384762 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:11.385479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.385918 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.386725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.387346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.567678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.577096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0c461b53-6961-488c-9ec8-ff5c577ec1d2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.203075 Jun 24 04:18:11.577828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 64/138] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:11 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:11.761406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:11.762328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:11.770301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.771025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.772359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.772542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.926856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:11.936515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9c716cb6-4a19-4c94-9549-692302e5fdb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.182321 Jun 24 04:18:11.938446 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 75/139] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:11 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:11.952176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:11.952781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:11.959754 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.960208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:11.960980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:11.961416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.081354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:12.081972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:12.088289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.088759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.089488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.090260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.244801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.254796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.256314 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.257409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eac55b65-34a5-43fc-8a24-99de701694a1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.182125 Jun 24 04:18:12.257967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 76/140] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:12 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:12.262348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:12.263130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:12.269606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.270047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.270977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.271407 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.297344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.305682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-be30300f-9441-49f9-8eb2-1a242a65c1f0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.357927 Jun 24 04:18:12.306265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 65/141] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:11 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:12.404571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.412416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ff6abcdd-55f7-4ae3-8e1f-6b7ecff8e982 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.153346 Jun 24 04:18:12.413160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 77/142] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:12 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:12.594881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:12.596100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:12.603964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.604545 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.605521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.605980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.760568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:12.770814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0574d0e2-c446-4e29-8719-4de37cb4be34 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1365 microversion: 2.1 time: 0.180257 Jun 24 04:18:12.773032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 66/143] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:12 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:12.953921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:12.954641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:12.960625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.961065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:12.965085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:12.965525 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.110649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-27e5e71c-4c0c-4de5-9e9a-d29556544e2a req-87bafb93-4592-4a6a-8874-a3ff82c784e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "name": "network-vif-plugged", "status": "completed", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:13.117518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.119292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-27e5e71c-4c0c-4de5-9e9a-d29556544e2a req-87bafb93-4592-4a6a-8874-a3ff82c784e4 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.119883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-27e5e71c-4c0c-4de5-9e9a-d29556544e2a req-87bafb93-4592-4a6a-8874-a3ff82c784e4 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.125856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fe894adb-0ae1-4aa5-829f-cf02b46e556b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.176792 Jun 24 04:18:13.126955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 78/144] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:12 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:13.132942 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-27e5e71c-4c0c-4de5-9e9a-d29556544e2a req-87bafb93-4592-4a6a-8874-a3ff82c784e4 service nova] Creating event network-vif-plugged:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:18:13.138500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-27e5e71c-4c0c-4de5-9e9a-d29556544e2a req-87bafb93-4592-4a6a-8874-a3ff82c784e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Jun 24 04:18:13.139112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 67/145] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:13.276726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:13.277328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:13.285453 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.285908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.286723 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.287155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.323915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:13.325054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:13.332204 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.332643 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.333436 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.333857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.338042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:13.425904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.442196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.444073 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.446084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fcf12ff3-0c65-483e-aded-4b9aba399a8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.173607 Jun 24 04:18:13.456834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 79/146] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:13 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:13.456834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:13.456834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:13.462981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.463524 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.464465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.464992 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.535415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.542785 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a3728380-62f7-4cd4-9ec9-dff57ed288f3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.223077 Jun 24 04:18:13.544356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 68/147] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:13 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:13.659831 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:13.667514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ea86a1f2-717c-4786-9c01-f25ac5d24361 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.218174 Jun 24 04:18:13.667897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 80/148] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:13 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:13.788792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:13.789395 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:13.798221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.798221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:13.798700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:13.799282 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.142285 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:14.143067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:14.149665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.150210 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.151300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.151738 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.158685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.166430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-beb0f305-c662-4427-bbb7-65528b65fdb6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1555 microversion: 2.1 time: 0.381394 Jun 24 04:18:14.167912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 69/149] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:13 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1555 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:14.183688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:14.184408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:14.190637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.191236 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.192135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.192568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.317899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.326172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1fc65455-dd8b-42f1-9972-ad1d808aa977 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.187693 Jun 24 04:18:14.326950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 81/150] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:14 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:14.340953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-450ad39b-1a5f-4fab-b951-ad59c621e7e6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160812 Jun 24 04:18:14.341578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 70/151] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:18:14 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:18:14.464513 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:14.465128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:14.474500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.474946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.485343 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.485815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.560462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:14.561449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:14.567903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.568652 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.570105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.570859 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.648446 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.661489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.665454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.667292 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0e6befe6-b801-49fd-997f-64d3b51941c2 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.206365 Jun 24 04:18:14.668688 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 82/152] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:14 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:14.691591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:14.693709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:14.707889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.708629 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.709596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:14.710228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:14.900043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.910293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c26fe460-0fb9-4cbd-8744-da4e2cbbf901 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.229186 Jun 24 04:18:14.920178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 83/153] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:14 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:14.951037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:14.965517 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-14d91d80-91d8-4c32-871d-7ddb0f313344 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.409722 Jun 24 04:18:14.975608 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 71/154] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:14 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:15.155014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734155da-ee09-4da7-aa56-2c506b7ed2cd", "name": "network-vif-plugged", "status": "completed", "tag": "15680038-79e1-44d0-bf98-1d22ed996825"}, {"server_uuid": "ab22e349-8bc5-4678-979e-0db7dfcfdb29", "name": "network-vif-plugged", "status": "completed", "tag": "628c6256-3f93-415e-8d57-183e79f02abb"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:15.165842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.166474 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.181224 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] Creating event network-vif-plugged:15680038-79e1-44d0-bf98-1d22ed996825 for instance 734155da-ee09-4da7-aa56-2c506b7ed2cd on hv-cinder-84684 Jun 24 04:18:15.181719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] Creating event network-vif-plugged:628c6256-3f93-415e-8d57-183e79f02abb for instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 on hv-cinder-84684 Jun 24 04:18:15.189021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-08747012-28d4-47d5-8017-3bdc382a37ec req-5c8906aa-b58b-47fe-b8fa-6c07def95643 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038209 Jun 24 04:18:15.189626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 84/155] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:15.344770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:15.345376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:15.351773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.352060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.352810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.353229 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.567915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:15.578444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-42a1cdbb-159e-466d-ae0f-b4e3bb9333e9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.238704 Jun 24 04:18:15.588217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 72/156] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:15 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:15.688100 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:15.699541 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:15.708863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.709508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.710659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.711200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.906477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:15.917923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:15.923667 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:15.926201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-182912b7-6a2d-4fbf-91d4-5a3d35d1bcea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.244686 Jun 24 04:18:15.927441 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:15.929754 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:15.939221 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 85/157] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:15 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:15.943183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.943978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.944745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.945348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.985216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:15.985926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:15.992505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.993202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:15.994125 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:15.994587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:16.170775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:16.179838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:16.182937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8551e592-8be3-4382-a09a-eaa22995c04a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.259844 Jun 24 04:18:16.183968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 73/158] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:15 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:16.189295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-c1ae774d-731e-4fe7-876e-7e8e49225a78 req-f9688c22-928f-49cd-bb24-8777f8bc6d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570", "tag": "9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:16.195463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7b1b53ac-62fb-4bc8-98a0-8465f9fe61b5 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.216271 Jun 24 04:18:16.196055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 86/159] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:15 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:16.198584 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c1ae774d-731e-4fe7-876e-7e8e49225a78 req-f9688c22-928f-49cd-bb24-8777f8bc6d38 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:16.199094 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c1ae774d-731e-4fe7-876e-7e8e49225a78 req-f9688c22-928f-49cd-bb24-8777f8bc6d38 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:16.211823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-c1ae774d-731e-4fe7-876e-7e8e49225a78 req-f9688c22-928f-49cd-bb24-8777f8bc6d38 service nova] Creating event network-changed:9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a for instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 on hv-cinder-84684 Jun 24 04:18:16.218286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-c1ae774d-731e-4fe7-876e-7e8e49225a78 req-f9688c22-928f-49cd-bb24-8777f8bc6d38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032453 Jun 24 04:18:16.219255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 74/160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:16.595962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:16.596601 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:16.603092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:16.603641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:16.604573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:16.605186 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:16.757109 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:16.765926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6f4b1824-95d3-4421-8c22-d4ebdd4911f8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.174238 Jun 24 04:18:16.776159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 87/161] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:16 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:16.946330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:16.947042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:16.954581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:16.955017 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:16.955790 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:16.956217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.108854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.122348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.122348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.122348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8ae3b4ad-11f4-4bab-8a05-89052c3d7a65 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.177894 Jun 24 04:18:17.122851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 75/162] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:16 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:17.200363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:17.200989 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:17.207518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.208183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.211141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.211141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.213240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:17.213849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:17.222883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.223333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.224104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.224535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.376209 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.385770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d94d166f-bad8-4ea1-98c7-37e0489cf4a2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.189670 Jun 24 04:18:17.390478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 88/163] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:17 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:17.390644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.399082 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-16b8ce4e-0be4-4131-83f3-1a73a8d54d7d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.189739 Jun 24 04:18:17.399750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 76/164] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:17 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:17.782947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:17.783550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:17.790987 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.791529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.792196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:17.792623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:17.930960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:17.938861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2c7daec5-e6f4-4f24-98ec-3c67cf60bc7d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.159621 Jun 24 04:18:17.939430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 89/165] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:17 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:18.138648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:18.139379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:18.151384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.151384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.151384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.151384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.278337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:18.286444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:18.287949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:18.289043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cf353dfa-a177-4360-ac86-019806ff8c79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.155045 Jun 24 04:18:18.289598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 77/166] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:18 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:18.404305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:18.404906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:18.410979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.411421 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.412180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.412609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.415653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:18.416264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:18.423735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.424369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.425318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.425767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.548480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:18.556210 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8157df8f-d77d-4bba-b944-25543f3189f2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.156043 Jun 24 04:18:18.556851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 90/167] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:18 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:18.582947 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:18.590885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-306ac5ac-cd9a-43b8-bf03-8f13355fa3d2 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.178478 Jun 24 04:18:18.591391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 78/168] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:18 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:18.956614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:18.957218 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:18.963223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.963664 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.964408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:18.964834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:18.985484 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:19.126425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.133817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-18756f3d-b2ac-43d8-9529-2152b8b4e6a4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.181056 Jun 24 04:18:19.134399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 91/169] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:18 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:19.312892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:19.313696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:19.314926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-3d93ca66-9ae2-4677-8727-7ccb5be4b460 req-1313619f-0ffa-4485-8a29-f3e94778f44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95960fad-f7dd-4195-97e2-b8519a0ac2d3", "name": "network-vif-plugged", "status": "completed", "tag": "743a00dc-b28e-4621-9d5a-757c991d77fb"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:19.320628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.321340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.322325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.322959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.326419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3d93ca66-9ae2-4677-8727-7ccb5be4b460 req-1313619f-0ffa-4485-8a29-f3e94778f44e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.326712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3d93ca66-9ae2-4677-8727-7ccb5be4b460 req-1313619f-0ffa-4485-8a29-f3e94778f44e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.352922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-3d93ca66-9ae2-4677-8727-7ccb5be4b460 req-1313619f-0ffa-4485-8a29-f3e94778f44e service nova] Creating event network-vif-plugged:743a00dc-b28e-4621-9d5a-757c991d77fb for instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 on hv-cinder-84684 Jun 24 04:18:19.358152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-3d93ca66-9ae2-4677-8727-7ccb5be4b460 req-1313619f-0ffa-4485-8a29-f3e94778f44e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053752 Jun 24 04:18:19.358979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 92/170] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:19.490481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.499116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.500612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.501688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3ea9033a-b7d5-4e98-8842-d6aea089838a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.197548 Jun 24 04:18:19.502233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 79/171] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:19 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:19.572993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:19.573637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:19.580719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.581162 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.581917 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.582345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.607775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:19.608724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:19.615244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.615635 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.616929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:19.617356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:19.731759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.740689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94c1e659-2588-4e78-b1ff-80f70e8349fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.171845 Jun 24 04:18:19.741263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 93/172] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:19 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:19.916100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:19.925319 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d5fc2662-da92-48ba-87ce-25ed1af340af tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1315 microversion: 2.1 time: 0.321433 Jun 24 04:18:19.933098 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 80/173] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:19 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:20.153576 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:20.154459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:20.161468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.161924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.162895 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.163253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.315340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:20.322620 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94931fe5-34c4-4867-bafc-a1189895a6ce tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.173780 Jun 24 04:18:20.323180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 94/174] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:20 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:20.520850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:20.521766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:20.528489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.528857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.529624 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.530055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.693757 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:20.706298 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:20.709460 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:20.711551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cfac58db-e2c1-4c94-b306-a104653bacfc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.194451 Jun 24 04:18:20.727222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 81/175] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:20 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:20.757760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:20.758593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:20.765770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.766310 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.767246 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.767676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.911462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:20.919268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-76c3bf55-e498-4265-ab6c-30898ad9aa4b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.165180 Jun 24 04:18:20.919987 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 95/176] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:20 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:20.942846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:20.943522 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:20.949512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.954022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:20.954022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:20.954022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.094843 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:21.102221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-944fc450-3eb7-49aa-917d-1885c8c6edf3 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1503 microversion: 2.1 time: 0.163530 Jun 24 04:18:21.102811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 82/177] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:20 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:21.342436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:21.343434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:21.351107 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.351684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.352449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.352882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.491114 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:21.499676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d01a75d8-7265-41eb-b8f7-547a57b14217 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.163380 Jun 24 04:18:21.500331 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 96/178] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:21 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:21.740316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:21.740920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:21.743936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:21.748775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.750478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.750478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.750478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.898476 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:21.907118 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:21.908643 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:21.909732 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-de294440-abd4-43cd-b9d8-e3702f218be0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.173339 Jun 24 04:18:21.910891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 83/179] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:21 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:21.937437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:21.938045 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:21.944424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.944857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:21.945599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:21.946026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:22.076325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:22.084058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cadb38a8-ac26-498c-a225-5cbdd7a4d846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1321 microversion: 2.1 time: 0.151636 Jun 24 04:18:22.084622 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 97/180] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:21 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:22.518485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:22.519081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:22.525284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:22.525724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:22.526499 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:22.526924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:22.676699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:22.684646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-573ed68c-7ab4-4284-867d-d88c3ab073c2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.170326 Jun 24 04:18:22.685414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 84/181] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:22 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:22.931959 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:22.932554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:22.939606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:22.940291 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:22.940739 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:22.941208 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.105466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:23.106171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:23.114034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.114507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.115271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.115705 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.144870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:23.155028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:23.156523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:23.159099 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bf526140-b9f6-4114-980f-81e9238b333b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1406 microversion: 2.20 time: 0.230272 Jun 24 04:18:23.159668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 98/182] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:22 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:23.222140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d651ea70-af19-4f41-88a0-7218fbd9dc83"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:23.223612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:23.233517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.233968 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.235040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.235826 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.307748 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:23.312879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:23.321956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2d38d525-af06-48dc-be1d-0ace2b8e802d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1515 microversion: 2.1 time: 0.220154 Jun 24 04:18:23.322560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 85/183] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:23 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:23.343645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:23.344651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:23.351225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.351729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.353246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.353629 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.382483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lazy-loading 'flavor' on Instance uuid 734155da-ee09-4da7-aa56-2c506b7ed2cd {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:18:23.841915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-642b739f-b7b0-4e18-a60f-68f8a3d81f16 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd/action" status: 200 len: 32 microversion: 2.1 time: 0.502539 Jun 24 04:18:23.849055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 86/184] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:18:23 2022] POST /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd/action => generated 32 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 04:18:23.849055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:23.849055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:23.861599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.862360 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:23.863376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:23.864016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.008778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:24.017681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-efda37e9-1d45-4d46-a0de-143265e5553a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.173644 Jun 24 04:18:24.018253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 87/185] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:23 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:24.023200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:24.023795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:24.031232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.031888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.032645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.033353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.171257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:24.178738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-96a8a5a3-1235-44a6-8d26-e017030bcdc9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.159264 Jun 24 04:18:24.179307 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 88/186] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:24 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:24.184657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:24.185250 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:24.191323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.191924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.192837 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.193408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.334107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:24.345278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:24.347269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:24.348493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f2e1275d-ca86-4089-a403-3d8d6cfce587 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1598 microversion: 2.20 time: 0.167772 Jun 24 04:18:24.350264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 89/187] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:18:24 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:18:24.376647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:24.377141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:24.384202 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.384893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.385653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:24.386239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:24.478592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e3b2d7d8-5b03-4eba-be67-4d4c94c0b2dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108705 Jun 24 04:18:24.479187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 90/188] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jun 24 04:18:24 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:18:25.035414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:25.037128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:25.044142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:25.044481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:25.045248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:25.045678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:25.283333 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-85bfb6d5-8afe-4d77-84ca-d0b463d03d8a tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "POST /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.064613 Jun 24 04:18:25.286301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 99/189] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:18:23 2022] POST /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be/os-volume_attachments => generated 194 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:18:25.326315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:25.329472 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:25.330470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:25.337823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fea21768-a126-42bb-924c-5215f0dda03e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1362 microversion: 2.1 time: 0.306497 Jun 24 04:18:25.338409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 91/190] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:25 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:25.339565 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:25.340212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:25.341209 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:25.341742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:25.632913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:25.641356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1e8e729f-f2e8-4194-bd73-833c028d8d05 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.353534 Jun 24 04:18:25.642953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 100/191] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:25 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:26.247068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-f6360ec0-e81e-469b-a386-7b9ca013bf00 req-7b63f4e4-0bbc-4d35-8343-1dc6e8fc83af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:26.267107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-f6360ec0-e81e-469b-a386-7b9ca013bf00 req-7b63f4e4-0bbc-4d35-8343-1dc6e8fc83af service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.267796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-f6360ec0-e81e-469b-a386-7b9ca013bf00 req-7b63f4e4-0bbc-4d35-8343-1dc6e8fc83af service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.282418 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-f6360ec0-e81e-469b-a386-7b9ca013bf00 req-7b63f4e4-0bbc-4d35-8343-1dc6e8fc83af service nova] Creating event network-changed:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:18:26.290267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-f6360ec0-e81e-469b-a386-7b9ca013bf00 req-7b63f4e4-0bbc-4d35-8343-1dc6e8fc83af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Jun 24 04:18:26.291945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 92/192] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:26.356522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:26.357234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:26.365535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.366346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.367154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.367610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.377864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-587989914", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:26.468604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] validate_networks() for None {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:18:26.666636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:26.677320 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b5011257-72bd-4803-8d34-76464c11c049 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1547 microversion: 2.1 time: 0.325666 Jun 24 04:18:26.678222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 101/193] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:26 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1547 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:26.691599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:26.692508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:26.701177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.701856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.703264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.703940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.943968 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:26.956130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-845e8a61-727e-4805-845c-b5b3260351e3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.274107 Jun 24 04:18:26.958735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 102/194] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:26 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:26.983031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:26.984007 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:26.991252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.991701 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:26.992477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:26.993218 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:27.122792 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-54644a5d-f763-402b-b13d-6ae422e5a457 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161202 Jun 24 04:18:27.123561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 103/195] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:18:26 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:27.141884 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:18:27.142294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:18:27.142946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:18:27.143498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:18:27.144051 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:18:27.160739 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:27.161301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:27.162160 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:27.162700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:27.181160 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Getting quotas for project 09b6462b30a34629bda3cfb3b7270c6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:18:27.190514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Getting quotas for user 9dbe4952ee034749b771ff380da6e06c and project 09b6462b30a34629bda3cfb3b7270c6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:18:27.203850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:18:27.206324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:18:27.415462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d0452f21-f614-4471-b734-8a446b37c2b9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044321 Jun 24 04:18:27.417005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 93/196] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:18:27.427892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2084906d-f003-4e8e-a9ea-b7eea7a148a4 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:27.428486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2084906d-f003-4e8e-a9ea-b7eea7a148a4 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:27.603027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2084906d-f003-4e8e-a9ea-b7eea7a148a4 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:27.625945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2084906d-f003-4e8e-a9ea-b7eea7a148a4 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1214 microversion: 2.1 time: 0.201773 Jun 24 04:18:27.635111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 104/197] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:27 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:27.977009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:27.978117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:27.988043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:27.988742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:27.989667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:27.990158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:28.199969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:28.208715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5b9975df-9422-4591-8d8e-aed6282dfcec tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.236177 Jun 24 04:18:28.218318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 94/198] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:27 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:28.649995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4554ca30-e3ea-4665-bbc6-013ae4fb4c77 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:28.650778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4554ca30-e3ea-4665-bbc6-013ae4fb4c77 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:28.732825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4554ca30-e3ea-4665-bbc6-013ae4fb4c77 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:28.741387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4554ca30-e3ea-4665-bbc6-013ae4fb4c77 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1214 microversion: 2.1 time: 0.095587 Jun 24 04:18:28.742135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 105/199] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:28 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:28.913960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-c6fc5cd0-947d-40ca-9d3d-e80b8d97f69b req-1682f7f6-4483-45a6-b324-7979b410e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95960fad-f7dd-4195-97e2-b8519a0ac2d3", "tag": "743a00dc-b28e-4621-9d5a-757c991d77fb"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:28.923580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c6fc5cd0-947d-40ca-9d3d-e80b8d97f69b req-1682f7f6-4483-45a6-b324-7979b410e2ec service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:28.924177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c6fc5cd0-947d-40ca-9d3d-e80b8d97f69b req-1682f7f6-4483-45a6-b324-7979b410e2ec service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:28.936040 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-c6fc5cd0-947d-40ca-9d3d-e80b8d97f69b req-1682f7f6-4483-45a6-b324-7979b410e2ec service nova] Creating event network-changed:743a00dc-b28e-4621-9d5a-757c991d77fb for instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 on hv-cinder-84684 Jun 24 04:18:28.941948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-c6fc5cd0-947d-40ca-9d3d-e80b8d97f69b req-1682f7f6-4483-45a6-b324-7979b410e2ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031992 Jun 24 04:18:28.943596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 95/200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:29.226440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:29.227119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:29.237315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:29.239972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:29.247479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:29.249998 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:29.421172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:29.431658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-789cbfb2-15e0-43c3-a85a-5a794f1dd173 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.209065 Jun 24 04:18:29.447251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 106/201] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:29 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:29.761690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:29.764255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:29.773308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:29.773906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:29.774850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:29.775465 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:29.883790 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:29.892041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-90f6091b-b303-4928-80ac-2b70e58255b1 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1266 microversion: 2.1 time: 0.137177 Jun 24 04:18:29.894553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 96/202] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:29 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:30.461096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:30.461707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:30.469017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:30.475960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:30.475960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:30.475960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:30.616089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:30.625772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-96c8d669-1094-46fe-a464-e7a47c8becb2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.168586 Jun 24 04:18:30.626528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 107/203] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:30 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:30.909541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:30.910190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:30.916430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:30.916883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:30.917646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:30.918340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:30.994310 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:31.001819 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-64c16c2b-eff3-4aae-9c76-0680e91b4f21 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1266 microversion: 2.1 time: 0.096359 Jun 24 04:18:31.002486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 97/204] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:30 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:31.649395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:31.650948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:31.659281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:31.659720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:31.660490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:31.660914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:31.874659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:31.887448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-687b41b4-6342-4eed-86ad-e9863e1e432b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.241215 Jun 24 04:18:31.888789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 108/205] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:31 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:32.020518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:32.022538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:32.028240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:32.028680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:32.029487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:32.029915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:32.109883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:32.120107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-add30ce6-0da1-44b3-8cc3-53f981c0e234 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1266 microversion: 2.1 time: 0.103272 Jun 24 04:18:32.120735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 98/206] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:32 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:32.912652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:32.913887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:32.922669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:32.922669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:32.923579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:32.924072 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:33.103516 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:33.107049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:33.111668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9e34fe6d-89ce-473f-8689-93e864e0503e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.202974 Jun 24 04:18:33.112225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 109/207] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:32 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:33.140151 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:33.140151 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:33.144638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:33.145069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:33.145809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:33.146232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:33.223634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:33.231943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-29cf7fd4-3fff-442e-a04c-30e81708f5de tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1266 microversion: 2.1 time: 0.098375 Jun 24 04:18:33.232671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 99/208] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:33 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:34.129736 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:34.130455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:34.136316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:34.136789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:34.137539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:34.137971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:34.250388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:34.251125 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:34.258341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:34.260433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:34.260433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:34.260433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:34.277327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:34.285806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f057b630-28f4-4845-b3ec-908316d497c0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.161636 Jun 24 04:18:34.286674 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 110/209] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:34 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:34.329045 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:34.337138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f7fec164-2ae0-4fd0-9b10-77f9df817710 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1274 microversion: 2.1 time: 0.092117 Jun 24 04:18:34.337704 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 100/210] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:34 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:35.303665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:35.304358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:35.311481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:35.311941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:35.316580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:35.316580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:35.354680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:35.356614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:35.363635 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:35.364336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:35.365251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:35.366067 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:35.445211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:35.455339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bf0e7ca3-b5f7-4925-bbdb-5c6af39ff493 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1272 microversion: 2.1 time: 0.104383 Jun 24 04:18:35.456778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 101/211] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:35 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:35.481466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:35.492986 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d674ed09-c499-45e2-bc1d-88d8464de19b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.193100 Jun 24 04:18:35.493740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 111/212] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:35 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:36.334413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:36.334907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:36.343801 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.344353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.345394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.345810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.379637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:18:36.385112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:36.473032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:36.474261 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:36.481305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.481863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.483435 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.484036 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.617298 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:36.626355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7a6dfa4f-da16-4f90-9d00-a42481e84081 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.157244 Jun 24 04:18:36.627233 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 112/213] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:36 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:36.645420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:36.646329 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:36.653558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.654990 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.656363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.656893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.714615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e14c0a52-434f-4ada-9f47-d797e6394ac8 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 204 len: 0 microversion: 2.1 time: 0.385105 Jun 24 04:18:36.715265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 102/214] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:18:36 2022] DELETE /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:18:36.729254 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:36.729952 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:36.736654 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.737104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.737867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:36.738305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:36.799941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:36.807981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7162074f-da30-4b16-9784-77dc3382fb67 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.170011 Jun 24 04:18:36.808503 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 113/215] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:36 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:36.985897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:36.994432 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6b5813c7-fe3f-43f0-b8fb-1b5e6a7a387d tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1555 microversion: 2.1 time: 0.269348 Jun 24 04:18:36.995020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 103/216] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:36 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:37.244789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-bd34a260-6bf0-403c-880d-15003d5a16ed req-a8a2c21a-107f-4afc-a865-8a670bd9d890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6c2630-e91d-4a96-a6c6-d6c3c45ae793", "tag": "e80694d2-50ab-4d1d-b2ba-0614dc294a4a"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:37.250605 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:37.256020 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-bd34a260-6bf0-403c-880d-15003d5a16ed req-a8a2c21a-107f-4afc-a865-8a670bd9d890 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:37.256454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-bd34a260-6bf0-403c-880d-15003d5a16ed req-a8a2c21a-107f-4afc-a865-8a670bd9d890 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:37.272284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-bd34a260-6bf0-403c-880d-15003d5a16ed req-a8a2c21a-107f-4afc-a865-8a670bd9d890 service nova] Creating event network-changed:e80694d2-50ab-4d1d-b2ba-0614dc294a4a for instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 on hv-cinder-84684 Jun 24 04:18:37.279179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-bd34a260-6bf0-403c-880d-15003d5a16ed req-a8a2c21a-107f-4afc-a865-8a670bd9d890 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037741 Jun 24 04:18:37.280232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 114/217] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:37.643663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:37.644289 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:37.646271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:37.647222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=6 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:37.653111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:37.653570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:37.654650 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:37.655343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:37.800691 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:37.808205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d43eedaa-56ee-4f26-a3f7-4389d33fe07e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.168414 Jun 24 04:18:37.808759 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 104/218] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:37 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:37.827043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:37.827847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:37.835272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:37.835886 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:37.837065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:37.837653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:37.966870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:37.975009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c3643c1-8572-4571-b434-9cffd471595e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.152892 Jun 24 04:18:37.975789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:37 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:38.015429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:38.016413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:38.023379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:38.023824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:38.024585 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:38.025194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:38.158907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:38.168840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e9684059-720e-475a-92a2-402d6d2187a9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1555 microversion: 2.1 time: 0.160535 Jun 24 04:18:38.169405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 105/220] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:38 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:38.825229 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:38.825857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:38.827946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:38.833386 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:38.833823 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:38.835558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:38.835558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:38.993757 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:38.994483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:39.001061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:39.001505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:39.002264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:39.002906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:39.183043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:39.195706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6cc7990b-6b5e-4c5a-a34b-e05810e5a704 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.374247 Jun 24 04:18:39.197979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 116/221] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:38 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:39.204268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:39.205257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:39.228893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:39.240111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:39.240825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:39.241780 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:39.242388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:39.244507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d24c1ca3-2a06-4167-adf3-b84354696be7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.252120 Jun 24 04:18:39.256736 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 106/222] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:38 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:39.494418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:39.503440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e3456aa6-1c6d-4ae0-8273-0c7224bbbd5e tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1555 microversion: 2.1 time: 0.303955 Jun 24 04:18:39.504105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 117/223] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:39 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:39.765824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-04854902-79d3-4075-bbcc-f57bd8eccd7a req-10a8101f-5586-4d17-8c94-1d1b20822814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f16fc0-cce2-4425-b19e-3d48d212e9be", "name": "network-vif-deleted", "tag": "9db12867-7f3c-4aed-ab68-f4fff1b4247b"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:39.774994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-04854902-79d3-4075-bbcc-f57bd8eccd7a req-10a8101f-5586-4d17-8c94-1d1b20822814 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:39.775434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-04854902-79d3-4075-bbcc-f57bd8eccd7a req-10a8101f-5586-4d17-8c94-1d1b20822814 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:39.787312 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-04854902-79d3-4075-bbcc-f57bd8eccd7a req-10a8101f-5586-4d17-8c94-1d1b20822814 service nova] Creating event network-vif-deleted:9db12867-7f3c-4aed-ab68-f4fff1b4247b for instance 01f16fc0-cce2-4425-b19e-3d48d212e9be on hv-cinder-84684 Jun 24 04:18:39.796262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-04854902-79d3-4075-bbcc-f57bd8eccd7a req-10a8101f-5586-4d17-8c94-1d1b20822814 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Jun 24 04:18:39.796878 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 107/224] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:40.214498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:40.215359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:40.222686 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.223121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.224043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.224468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.261594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:40.263478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:40.270702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.273263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.275302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.275745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.443051 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:40.452913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-48994dad-86c7-4afe-9f06-6fe7a412b43c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.195307 Jun 24 04:18:40.463171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 108/225] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:40 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:40.527696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:40.528347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:40.541426 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.542613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.543582 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:40.544171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:40.590443 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:40.608117 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-797fc1fd-627d-4341-95f8-231628ad9c47 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.397576 Jun 24 04:18:40.608952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 118/226] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:40 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:40.627109 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:40.636011 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f1f66a0a-680f-424e-bd54-9e5fc7746a73 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1346 microversion: 2.1 time: 0.112388 Jun 24 04:18:40.636577 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 109/227] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:40 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:41.469731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:41.470332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:41.476607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.477039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.477797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.478283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.621352 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:41.627100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:41.627701 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:41.630228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-549c9061-47d8-4952-b3b9-ba6b4188ca26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.164291 Jun 24 04:18:41.640657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 119/228] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:41 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:41.640868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.640868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.640868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.640868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.659601 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:41.660919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:41.673305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.674094 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.674978 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.675623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.708929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:41.709477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:41.709968 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lazy-loading 'fault' on Instance uuid 01f16fc0-cce2-4425-b19e-3d48d212e9be {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:18:41.760982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8237a791034b80973d5cc4329d015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48b90744f124a21b9e8d2b78836462e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:41.771942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8d557f49-9d9e-448c-a3e5-2e19fb012d16 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 200 len: 1351 microversion: 2.1 time: 0.119925 Jun 24 04:18:41.772615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 120/229] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:41 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:41.799449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:41.810001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9841ea76-b0d3-4e29-87f7-03f210ed985e tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.185759 Jun 24 04:18:41.810001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 110/230] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:41 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:42.648599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:42.649273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:42.656309 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.656756 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.657544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.657975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.788953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:42.790799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:42.799693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:42.805351 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.806341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.807017 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.807431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.818897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dd204438-9476-4a6f-94e0-4bf99427c7e9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.172672 Jun 24 04:18:42.818897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 121/231] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:42 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:42.830428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:42.831414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] HTTP exception thrown: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.831534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Request method failure captured: Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be HTTP/1.1 Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrYaDPBpCREI8_kPKZGRF438ubMSbBZuzsXuZ6dQgMCW62DIk1EkboMLAZBJWSo5oIKA3xhuUHTK-LenqrOKhbnIWT_xd6a0PLY4nxlzZUwZ4t4YZX2rk8MCAvDOhU3fxyuNDH0BZ0DeV6c5YfIYHO0G1VfGSnWHzieu3EqoRD3qqw Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:18:42.836158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a48b90744f124a21b9e8d2b78836462e"}]}] Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: aa8237a791034b80973d5cc4329d015c Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.837688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '01f16fc0-cce2-4425-b19e-3d48d212e9be'} Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:18:42.838758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.840259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.841779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Returning 404 to user: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:18:42.841779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-839d57aa-6e97-4f67-a4cd-b5d85cf3eb27 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 404 len: 111 microversion: 2.1 time: 0.052541 Jun 24 04:18:42.841779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 111/232] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:42 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 04:18:42.845003 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.845459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.846234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.847082 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.961607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:42.962880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:42.970225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.970971 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.971982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:42.972407 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:42.988186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] HTTP exception thrown: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Request method failure captured: Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be/os-volume_attachments HTTP/1.1 Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrYaDPBpCREI8_kPKZGRF438ubMSbBZuzsXuZ6dQgMCW62DIk1EkboMLAZBJWSo5oIKA3xhuUHTK-LenqrOKhbnIWT_xd6a0PLY4nxlzZUwZ4t4YZX2rk8MCAvDOhU3fxyuNDH0BZ0DeV6c5YfIYHO0G1VfGSnWHzieu3EqoRD3qqw Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:18:42.991161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a48b90744f124a21b9e8d2b78836462e"}]}] Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: aa8237a791034b80973d5cc4329d015c Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.992446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'server_id': '01f16fc0-cce2-4425-b19e-3d48d212e9be'} Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:18:42.993130 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:42.994173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:18:42.996791 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Returning 404 to user: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:18:42.997873 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fed4ebb1-c8b5-45cb-a6ae-261c78f388b0 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040184 Jun 24 04:18:42.999153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 112/233] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:18:42 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:18:43.002458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:43.012722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f65c12a4-7f98-4ca3-8837-c45e2f05f169 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.190183 Jun 24 04:18:43.013440 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 122/234] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:42 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:43.439224 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-2e9ac6ec-3ded-4116-b39c-6603486aff65 req-43b32746-4187-45e6-835c-22e9ea1537ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6c2630-e91d-4a96-a6c6-d6c3c45ae793", "name": "network-vif-plugged", "status": "completed", "tag": "e80694d2-50ab-4d1d-b2ba-0614dc294a4a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:43.447324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-2e9ac6ec-3ded-4116-b39c-6603486aff65 req-43b32746-4187-45e6-835c-22e9ea1537ca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:43.447764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-2e9ac6ec-3ded-4116-b39c-6603486aff65 req-43b32746-4187-45e6-835c-22e9ea1537ca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:43.459221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-2e9ac6ec-3ded-4116-b39c-6603486aff65 req-43b32746-4187-45e6-835c-22e9ea1537ca service nova] Creating event network-vif-plugged:e80694d2-50ab-4d1d-b2ba-0614dc294a4a for instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 on hv-cinder-84684 Jun 24 04:18:43.464076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-2e9ac6ec-3ded-4116-b39c-6603486aff65 req-43b32746-4187-45e6-835c-22e9ea1537ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029343 Jun 24 04:18:43.465227 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 113/235] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:43.833366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:43.833921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:43.840800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:43.841414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:43.843391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:43.843833 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:43.973137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:43.980741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fd04c4d9-2f01-420b-b427-7c7b33e65fa7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.151504 Jun 24 04:18:43.981295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 123/236] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:43 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:44.030579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:44.031387 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:44.037681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:44.038206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:44.039065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:44.039563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:44.169044 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:44.177036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4e08d3ce-89cf-4ad4-9af8-1c708806b9fb tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.150753 Jun 24 04:18:44.177590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 114/237] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:44 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:44.996984 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:44.997575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:45.005184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:45.005620 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:45.006395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:45.006834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:45.138612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:45.145962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fec6bbe2-eb66-44a0-887e-51060d9936d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.152880 Jun 24 04:18:45.146558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 124/238] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:44 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:45.192768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:45.193402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:45.199414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:45.199841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:45.200609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:45.201045 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:45.330172 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:45.342947 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-198bf2b1-9420-471f-8c9f-4e716bb5bc76 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.153488 Jun 24 04:18:45.343944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 115/239] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:45 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:46.162953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:46.163555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:46.170611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:46.171051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:46.171800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:46.172230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:46.361181 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:46.361766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:46.367925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:46.368346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:46.369167 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:46.369593 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:46.462120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:46.473179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bdc935f2-87cf-4bb8-b53c-fbab1e265846 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.313943 Jun 24 04:18:46.474523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 125/240] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:46 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:46.517603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:46.525733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cd6ee2ae-ea28-4936-b9c6-b3db28e0b818 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.169569 Jun 24 04:18:46.526297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 116/241] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:46 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:47.489720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:47.490251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:47.496763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.497279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.498962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.499467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.543187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:47.543822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:47.550306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.550782 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.551537 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.551960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.642115 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:47.645499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:47.650213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0208381e-fa2f-4246-9368-d33ad4e4ea7d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.164481 Jun 24 04:18:47.650801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 126/242] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:47 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:47.663529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:47.664568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:47.675041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.675834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.677061 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.677762 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.695435 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] HTTP exception thrown: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Request method failure captured: Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be HTTP/1.1 Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrYaDPBpCREI8_kPKZGRF438ubMSbBZuzsXuZ6dQgMCW62DIk1EkboMLAZBJWSo5oIKA3xhuUHTK-LenqrOKhbnIWT_xd6a0PLY4nxlzZUwZ4t4YZX2rk8MCAvDOhU3fxyuNDH0BZ0DeV6c5YfIYHO0G1VfGSnWHzieu3EqoRD3qqw Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:18:47.700144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a48b90744f124a21b9e8d2b78836462e"}]}] Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: aa8237a791034b80973d5cc4329d015c Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.705703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '01f16fc0-cce2-4425-b19e-3d48d212e9be'} Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:18:47.706649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.707937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.709348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Returning 404 to user: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:18:47.709348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ce07da96-f604-437a-bdc1-65efee67fde9 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 404 len: 111 microversion: 2.1 time: 0.045697 Jun 24 04:18:47.709348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 127/243] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:18:47 2022] DELETE /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:18:47.709616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:47.711890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:47.712526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] [instance: 01f16fc0-cce2-4425-b19e-3d48d212e9be] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:47.713686 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1fd1e6d2-1f34-4045-bc81-304c3412fcf9 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.174259 Jun 24 04:18:47.714266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 117/244] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:47 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:47.719309 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.724953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.724953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:47.724953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:47.735340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] HTTP exception thrown: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Request method failure captured: Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be HTTP/1.1 Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrYaDPBpCREI8_kPKZGRF438ubMSbBZuzsXuZ6dQgMCW62DIk1EkboMLAZBJWSo5oIKA3xhuUHTK-LenqrOKhbnIWT_xd6a0PLY4nxlzZUwZ4t4YZX2rk8MCAvDOhU3fxyuNDH0BZ0DeV6c5YfIYHO0G1VfGSnWHzieu3EqoRD3qqw Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:18:47.736862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a48b90744f124a21b9e8d2b78836462e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a48b90744f124a21b9e8d2b78836462e"}]}] Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: a48b90744f124a21b9e8d2b78836462e Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-DeleteServersTestJSON-1686592052 Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: aa8237a791034b80973d5cc4329d015c Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-DeleteServersTestJSON-1686592052-project Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.738243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '01f16fc0-cce2-4425-b19e-3d48d212e9be'} Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:18:47.739065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. Jun 24 04:18:47.742335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:47.743587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] Returning 404 to user: Instance 01f16fc0-cce2-4425-b19e-3d48d212e9be could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:18:47.743587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3aadb3e1-20d1-47fe-b993-8a5d89fe5db4 tempest-DeleteServersTestJSON-1686592052 tempest-DeleteServersTestJSON-1686592052-project] 10.222.0.16 "GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be" status: 404 len: 111 microversion: 2.1 time: 0.031145 Jun 24 04:18:47.743587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 128/245] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:47 2022] GET /compute/v2.1/servers/01f16fc0-cce2-4425-b19e-3d48d212e9be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:18:48.667519 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:48.668110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:48.675421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:48.675765 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:48.676527 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:48.676949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:48.731048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:48.731652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:48.739793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:48.740242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:48.741002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:48.741427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:48.875570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:48.889772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-48c2cc81-364c-4cfb-990f-fa109f3d6fa2 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.161680 Jun 24 04:18:48.896423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 129/246] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:48 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:48.903398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:48.916676 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1423e90b-0283-4286-baf6-4a8af7ef674c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.252786 Jun 24 04:18:48.917641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 118/247] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:48 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:49.907686 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:49.908279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:49.915180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:49.918590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:49.918590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:49.918590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:49.933122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:49.933723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:49.945842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:49.945842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:49.945842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:49.945842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:50.071410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:50.081455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ed12507f-2ff0-46c8-a5d0-28b127d7fc45 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.177647 Jun 24 04:18:50.086421 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 130/248] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:49 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:50.154891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:50.165213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9d87cbe8-2d0d-4fdb-8f07-675c286a7cc0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.235823 Jun 24 04:18:50.169531 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 119/249] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:49 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:18:51.097923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:51.098742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:51.107766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:51.108257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:51.113692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:51.113692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:51.182246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:51.184185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:51.203514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:51.204732 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:51.206317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:51.209654 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:51.244136 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:51.300624 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:51.309668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-64863c3c-77b6-426b-adfa-c8bd9ab2875a tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1314 microversion: 2.1 time: 0.215730 Jun 24 04:18:51.310975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 131/250] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:51 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:51.469234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:51.481779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-327947a7-dbf2-429a-8451-c9a3f882f086 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.303510 Jun 24 04:18:51.493280 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 120/251] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:51 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:52.329216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:52.329852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:52.337301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.337928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.338929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.339569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.500120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:52.500722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:52.508019 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.508465 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.509227 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.509653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.542954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:52.553150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06c55cb2-88f7-4d10-8c3b-50431706a2dd tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1464 microversion: 2.1 time: 0.229192 Jun 24 04:18:52.553860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 132/252] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:52 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:52.598025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:52.598851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:52.605569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.605877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.608821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:52.609499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:52.639429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:18:52.664651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:52.673420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2f7beab3-14a8-4107-84a1-85b9d76d14f1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.177900 Jun 24 04:18:52.683223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 121/253] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:52 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:53.085041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-882585d5-44f9-49f3-b92e-4f38595ff4fe tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 204 len: 0 microversion: 2.1 time: 0.490321 Jun 24 04:18:53.086351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 133/254] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:18:52 2022] DELETE /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:18:53.099449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:53.100420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:53.103540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:18:53.111921 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:53.112645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:53.113719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:53.114339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:53.269709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:53.278756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-25893885-6a92-4149-a712-b8ce385243c6 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1470 microversion: 2.1 time: 0.185858 Jun 24 04:18:53.279939 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 122/255] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:53 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:53.691198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:53.691898 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:53.698195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:53.698677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:53.699426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:53.699851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:53.853163 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:53.853163 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9d284fe7-8bef-4011-a0b8-e793266f009b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.161118 Jun 24 04:18:53.853163 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 134/256] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:53 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:54.308344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:54.308988 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:54.315870 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:54.316321 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:54.317099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:54.317525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:54.720142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:54.727951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02d96b81-79c8-4d2e-9f6c-5a906d2735b3 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1470 microversion: 2.1 time: 0.423216 Jun 24 04:18:54.728514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 123/257] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:54 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:54.865022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:54.866578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:54.880824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:54.880824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:54.880824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:54.880824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:55.195341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:55.207681 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-837c8cad-123e-44e4-b64f-d355f57b471e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.346524 Jun 24 04:18:55.208848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 135/258] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:54 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:55.657497 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-990725b0-9aff-45e6-8cf1-aa46ead18ddc req-a24e15ef-2671-4d4f-865a-d7225832ee11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6c2630-e91d-4a96-a6c6-d6c3c45ae793", "name": "network-vif-deleted", "tag": "e80694d2-50ab-4d1d-b2ba-0614dc294a4a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:18:55.667642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-990725b0-9aff-45e6-8cf1-aa46ead18ddc req-a24e15ef-2671-4d4f-865a-d7225832ee11 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:55.668100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-990725b0-9aff-45e6-8cf1-aa46ead18ddc req-a24e15ef-2671-4d4f-865a-d7225832ee11 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:55.684760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-990725b0-9aff-45e6-8cf1-aa46ead18ddc req-a24e15ef-2671-4d4f-865a-d7225832ee11 service nova] Creating event network-vif-deleted:e80694d2-50ab-4d1d-b2ba-0614dc294a4a for instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 on hv-cinder-84684 Jun 24 04:18:55.692994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-990725b0-9aff-45e6-8cf1-aa46ead18ddc req-a24e15ef-2671-4d4f-865a-d7225832ee11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044686 Jun 24 04:18:55.697588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 124/259] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:18:55.745138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:55.745744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:55.754044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:55.755793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:55.756759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:55.757195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:55.828062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:55.835948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2a76b5ba-1ad3-4230-a9c5-61af11f95e6c tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1428 microversion: 2.1 time: 0.094496 Jun 24 04:18:55.836551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 136/260] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:55 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:56.226061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:56.226769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:56.233080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:56.233523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:56.234269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:56.234734 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:56.370465 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:56.378561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4baaa6c9-7937-4c2b-bae1-af088be4750b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.156729 Jun 24 04:18:56.379114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 125/261] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:56 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:56.853108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:56.853538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:56.868006 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:56.868453 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:56.869227 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:56.871793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:56.916595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:56.917156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:56.917548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lazy-loading 'fault' on Instance uuid ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:18:56.975197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbe4952ee034749b771ff380da6e06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b6462b30a34629bda3cfb3b7270c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:56.985561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-de80f301-bc0e-4f8c-b980-b6aabc8af082 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 200 len: 1304 microversion: 2.1 time: 0.136262 Jun 24 04:18:56.986752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 137/262] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:56 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:57.403485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:57.407302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:57.422517 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:57.426683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:57.428215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:57.428666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:57.682591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:57.692641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4b34dcd0-747a-431c-aaab-f662d5b956eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.301083 Jun 24 04:18:57.693303 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 126/263] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:57 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:18:58.009327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:58.009945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] [instance: ea6c2630-e91d-4a96-a6c6-d6c3c45ae793] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:58.017585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:58.018042 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:58.019123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:58.019560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:58.052744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] HTTP exception thrown: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Request method failure captured: Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 HTTP/1.1 Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTsQTXDcJrZmmut0RP8Nxtmv8Bcsrp_cc3xx-_0-WCNV-FYtn6lPXZl1glxc7qj1TfymSOHahrtDhW4qkC5Bo3lPzZ3Z1AUDsWEdrKhkbMtYS4FquDxyqdgEf-kf0fcAp9aZ9izVTOiUjAZB9kdt38nCuu7CVKM5zKfT2PD8cpu85dQ Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 09b6462b30a34629bda3cfb3b7270c6d Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesNegativeTest-378463561 Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:18:58.054415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09b6462b30a34629bda3cfb3b7270c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09b6462b30a34629bda3cfb3b7270c6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09b6462b30a34629bda3cfb3b7270c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09b6462b30a34629bda3cfb3b7270c6d"}]}] Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesNegativeTest-378463561 Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 09b6462b30a34629bda3cfb3b7270c6d Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesNegativeTest-378463561 Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesNegativeTest-378463561-project Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 9dbe4952ee034749b771ff380da6e06c Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesNegativeTest-378463561-project Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. Jun 24 04:18:58.055628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ea6c2630-e91d-4a96-a6c6-d6c3c45ae793'} Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:18:58.056344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. Jun 24 04:18:58.057485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:18:58.059955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] Returning 404 to user: Instance ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:18:58.059955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-43afd078-b92e-4185-9101-4b925f0f7e05 tempest-VolumesNegativeTest-378463561 tempest-VolumesNegativeTest-378463561-project] 10.222.0.16 "GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793" status: 404 len: 111 microversion: 2.1 time: 0.050578 Jun 24 04:18:58.063166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 138/264] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:58 2022] GET /compute/v2.1/servers/ea6c2630-e91d-4a96-a6c6-d6c3c45ae793 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:18:58.715323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:18:58.715951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:18:58.732450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:58.733219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:58.734206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:18:58.735099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:18:58.993088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:18:59.002261 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d7d69c4a-8d40-4258-a555-bc9625668484 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.292862 Jun 24 04:18:59.002881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 127/265] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:18:58 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:00.035712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:00.037263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:00.054087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:00.056359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:00.061168 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:00.062128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:00.326865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:00.337750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a56a5359-25a1-4b32-ae65-c6c015fe8aaa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.314467 Jun 24 04:19:00.339014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 139/266] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:00 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:01.355598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:01.356257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:01.363851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:01.364344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:01.365133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:01.365555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:01.529539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:01.529539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-10a77c23-1c73-4d3a-aa74-2fa61f6f13a4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.166611 Jun 24 04:19:01.529539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 128/267] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:01 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:02.540436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:02.541038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:02.547936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:02.548371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:02.549152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:02.549578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:02.779467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:02.791332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5512bfe4-fa26-4caf-8129-f8f077b69f24 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.252002 Jun 24 04:19:02.791332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 140/268] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:02 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:03.805613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:03.811430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:03.817053 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:03.817643 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:03.818457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:03.819032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:04.083281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:04.090471 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-356575b6-317c-49f2-891b-9eeca9a44b19 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.289005 Jun 24 04:19:04.102543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 129/269] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:03 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:05.110642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:05.111971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:05.135585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:05.138173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:05.139657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:05.142532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:05.385324 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:05.395782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7a4edff4-d5dd-4a49-bde7-269a858869d3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.290545 Jun 24 04:19:05.397490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 141/270] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:05 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:06.415312 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:06.415924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:06.422981 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:06.423336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:06.424116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:06.424597 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:06.722831 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:06.734832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bfc81ceb-a4a3-4b87-a3d3-a2b221535703 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.324361 Jun 24 04:19:06.737366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 130/271] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:06 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:07.758152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:07.759833 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:07.772287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:07.773449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:07.775198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:07.776005 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:08.094195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:08.112482 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eaef8faa-16fe-433d-8ecc-4270ceb0f567 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.361999 Jun 24 04:19:08.113622 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 142/272] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:07 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:09.130006 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:09.131016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:09.137443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:09.138760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:09.139818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:09.140443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:09.469138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:09.482294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-78215dc6-0a0e-4c34-acd4-ed7dac97f780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.356032 Jun 24 04:19:09.484141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 131/273] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:09 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:10.501411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:10.505801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:10.528134 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:10.536207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:10.537454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:10.539833 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:10.540943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:10.590699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:10.890007 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:10.898479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a14cb021-931d-4605-b2a4-e839af988f38 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.403627 Jun 24 04:19:10.899060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 143/274] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:10 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:11.927257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:11.927257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:11.956559 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:11.961134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:11.972124 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:11.972658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:12.069682 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:12.071258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:12.112178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:12.112627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:12.114631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:12.115080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:12.164700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b27dc79b-73fb-4138-b929-e2f3f3890d57 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/ips" status: 200 len: 149 microversion: 2.1 time: 0.100636 Jun 24 04:19:12.175497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 144/275] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:19:12 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/ips => generated 149 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:12.364534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:12.375341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-35ffaa66-ec7a-4492-b7df-4958b8f3a33c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1521 microversion: 2.1 time: 0.462906 Jun 24 04:19:12.376609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 132/276] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:11 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:12.681831 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-db0b1f74-ca8d-4730-910b-c6b146aa6c7f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Action: 'create', calling method: .version_select at 0x7fdfed3bb430>, body: {"keypair": {"name": "tempest-TestShelveInstance-158798097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAOs2YQO9u45nv8B+DgpbwtgtP7NePhW+59er44A/FtnLMiii2n/Mo7CheOc5kCZ9easAerCYpgj6IKEonjN1UUu5PHr7uF0hA3YFGa1Cvi1pdoifVzIYSmG5gNL+4mlQ=="}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:12.703692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-db0b1f74-ca8d-4730-910b-c6b146aa6c7f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Getting quotas for project 7e75e404ef4f4118a95ca8fb8d98becd. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:12.711008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-db0b1f74-ca8d-4730-910b-c6b146aa6c7f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Getting quotas for user f3821e46c09b449d85c46c58d99bf607 and project 7e75e404ef4f4118a95ca8fb8d98becd. Resources: {'key_pairs'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:12.845159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-db0b1f74-ca8d-4730-910b-c6b146aa6c7f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.510713 Jun 24 04:19:12.845821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 145/277] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:19:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:13.393856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:13.394395 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:13.400933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:13.401575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:13.419099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:13.419653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:13.420445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:13.420866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:13.426687 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:13.427135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:13.427911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:13.428336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:13.527514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ecd4bd8d-051a-420b-aad2-9abbeed2c67b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/ips" status: 200 len: 152 microversion: 2.20 time: 0.137942 Jun 24 04:19:13.529639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 133/278] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jun 24 04:19:13 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:19:14.024439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:14.033563 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2ca44ea1-22fd-452f-93ec-1a3268ab85da tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1501 microversion: 2.1 time: 0.638010 Jun 24 04:19:14.043293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 146/279] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:13 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1501 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:14.056244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:14.056850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:14.064444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:14.064891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:14.066480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:14.066480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:14.339918 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:14.352693 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-66d82d27-e39e-4dd6-8d7c-97fb94e49273 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1516 microversion: 2.1 time: 0.299115 Jun 24 04:19:14.354749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 134/280] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:14 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:14.413157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937b2e71-bcbb-497d-bf6c-f42450e14f8c"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:14.414415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:14.438413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:14.438936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:14.439826 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:14.440600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:16.361589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:16.364997 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:16.390418 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:16.391659 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:16.398126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:16.398876 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:16.457162 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-22942e4a-d9c1-4017-819d-79cca7f33aaf tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/ips" status: 200 len: 145 microversion: 2.1 time: 0.112805 Jun 24 04:19:16.467934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 135/281] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:19:16 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/ips => generated 145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:16.660637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a8696801-c611-4288-9ce4-163022bbe211 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.252903 Jun 24 04:19:16.663677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 147/282] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:19:14 2022] POST /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 194 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:16.881490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:16.882480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:16.891568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:16.892037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:16.893501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:16.893935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:16.930457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lazy-loading 'flavor' on Instance uuid b085e856-e8d0-451d-be61-532ea491655b {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:19:17.053631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:17.054777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:17.074068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.078771 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:17.081963 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.082756 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:17.132792 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lazy-loading 'flavor' on Instance uuid ab22e349-8bc5-4678-979e-0db7dfcfdb29 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:19:17.201256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:17.647291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-25a1157a-047f-44b2-b5af-38c28dd783bc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/action" status: 202 len: 0 microversion: 2.20 time: 0.769464 Jun 24 04:19:17.652669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 136/283] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jun 24 04:19:16 2022] POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:19:17.685344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-82d8700c-77f3-4217-9f86-c2ed588089d9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/action" status: 200 len: 32 microversion: 2.1 time: 0.640712 Jun 24 04:19:17.686291 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 148/284] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:19:17 2022] POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/action => generated 32 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 04:19:17.705801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:17.706528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:17.707567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:17.709219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:17.723555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.724200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:17.728541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.728541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:17.736605 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.737067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:17.746538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:17.747443 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:18.071071 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:18.085322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:18.085322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:18.086026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-15f1c5a4-2b4b-48f6-9f08-8492b357c551 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.415684 Jun 24 04:19:18.098772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 137/285] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:17 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:18.302889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:18.316239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35ee4c6d-9afc-43d2-ae12-d6abaeb980e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.621194 Jun 24 04:19:18.329456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 149/286] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:17 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:19.105034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:19.105652 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:19.115188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:19.115188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:19.115188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:19.115588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:19.342700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:19.344179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:19.357310 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:19.362603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:19.362603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:19.362603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:19.394123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:19.405684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:19.408612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:19.428856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-401389b4-0249-438b-93ad-eef7eebffa99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.309304 Jun 24 04:19:19.428856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 138/287] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:19 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:19.657999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:19.668009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-558cf2bf-35b3-4ac3-b0c9-52ba38480369 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.331994 Jun 24 04:19:19.669693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 150/288] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:19 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:20.445726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:20.446330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:20.467928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.470618 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.472549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.473541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.475687 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26296ee5-6308-40f5-8724-9c161f945a50"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:20.479603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:20.491325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.491797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.492564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.492997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.700744 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:20.710799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:20.713222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:20.715035 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8e37fb9f-fe83-4d5e-a371-062a984c1a55 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.273280 Jun 24 04:19:20.727766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 139/289] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:20 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:20.734231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:20.735230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:20.743366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.744453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.745690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:20.747780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:20.937468 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:20.945050 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-72b8435f-8038-43a5-95b6-7d63e7b1cbb9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.215902 Jun 24 04:19:20.945616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 140/290] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:20 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:21.436758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1577fbb9-1d39-4767-8ac6-1d332f5e3d90 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965211 Jun 24 04:19:21.437557 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 151/291] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:19:20 2022] POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:19:21.736088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:21.736701 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:21.743875 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:21.744598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:21.748758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:21.749621 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:21.972890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:21.974887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:21.975184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:21.984468 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:21.985977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:21.987013 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:21.987694 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:21.989264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:21.992657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9176daf1-8181-4114-9c6e-1e37026fd978 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.261555 Jun 24 04:19:21.996167 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 141/292] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:21 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:22.030914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:22.347774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:22.394811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dc6cc0bd-0937-44c2-9b9e-8265a20d3f04 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.432780 Jun 24 04:19:22.395943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 152/293] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:21 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:23.017123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:23.019145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:23.033703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:23.034159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:23.037245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:23.037693 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:23.340304 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:23.350356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:23.353657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:23.355100 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8ed0d971-2b5f-4a03-90b2-e56ac398cfa4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.345559 Jun 24 04:19:23.376956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 142/294] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:23 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:23.412927 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:23.413745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:23.421038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:23.436100 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:23.437992 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:23.455932 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:23.455932 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:23.718454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:23.742126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0897a7d9-8f72-4eb4-ba19-f708bf43c4a6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.327770 Jun 24 04:19:23.750473 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 153/295] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:23 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:24.402065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:24.403285 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:24.406812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=42 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:24.431539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:24.431539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:24.431539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:24.439277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:24.677317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:24.687494 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:24.689193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:24.696792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ef084e09-2a02-4b09-aa17-9e314750d255 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.312285 Jun 24 04:19:24.697390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 143/296] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:24 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:24.759715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:24.760484 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:24.773313 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:24.774077 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:24.775266 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:24.775733 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:24.940388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:24.950653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-43e02c87-d6f6-4d21-9af3-1fe63475c622 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.194936 Jun 24 04:19:24.954662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 154/297] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:24 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:25.267330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c39f724f-8334-4f13-8fcd-5353ebd9cd94 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: .version_select at 0x7fdfedbcfb80>, body: {"keypair": {"name": "tempest-keypair-414504536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl30c3BsTAkaqBeVh4STSy34JGDE0d4uOPP/rGwA/Na7dyqzCM4SFuvKqIv1FWHjzli6bCcRGOEIEts/7keuZiaRQdzpLRhu/I7HvxS2mPvzgoIJ3h1UUaQ0ykTw0rvsw=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:25.302079 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-c39f724f-8334-4f13-8fcd-5353ebd9cd94 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:25.312172 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-c39f724f-8334-4f13-8fcd-5353ebd9cd94 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:25.433481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c39f724f-8334-4f13-8fcd-5353ebd9cd94 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171350 Jun 24 04:19:25.434855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 144/298] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:19:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:25.719430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:25.720458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:25.732643 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:25.736568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:25.736568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:25.736568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:25.972985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:25.973613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:25.999013 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:26.003033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:26.011617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:26.014412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:26.263165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:26.275063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:26.275761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:26.280801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-08fced9a-affc-4768-94b4-4ef8c7d1850c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.567513 Jun 24 04:19:26.282684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 155/299] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:25 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:26.401657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:26.415193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02827290-f0b1-470b-b3a7-991061b0643a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.450020 Jun 24 04:19:26.426357 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 145/300] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:25 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:27.300767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:27.301377 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:27.343935 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:27.344404 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:27.345236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:27.345669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:27.437619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:27.439530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:27.458142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:27.458490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:27.459459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:27.460044 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:27.703107 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:27.708426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:27.722272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:27.723931 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:27.738046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:27.741517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a25d5641-a4ff-4f6b-bd4c-11ef9401590d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.432783 Jun 24 04:19:27.745946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-17c909bb-f5cc-47b4-b510-a1981e647cd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.314102 Jun 24 04:19:27.756417 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 156/301] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:27 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:27.756924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 146/302] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:27 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:28.765615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:28.767234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:28.783625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:28.785382 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:28.825808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:28.826406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:28.827319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:28.828573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:28.829220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:28.830769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:28.832076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:28.834810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:29.256426 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:29.271059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:29.273296 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:29.274875 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cf577004-c57d-4b19-b060-918010543d20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.503241 Jun 24 04:19:29.275598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 147/303] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:28 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:29.441193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:29.452766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06c99131-ed1a-4e2b-b56a-6ca3ffdfc723 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.693536 Jun 24 04:19:29.463638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 157/304] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:28 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:29.563026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1413693720", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7"}], "security_groups": [{"name": "tempest-securitygroup--1997694739"}], "key_name": "tempest-keypair-414504536", "user_data": "}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:30.303753 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:30.304946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:30.312777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:30.313229 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:30.314143 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:30.314668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:30.508117 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:30.526793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:30.531025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:30.531025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-27411009-4b65-4ed7-8bac-05a019df594d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.238996 Jun 24 04:19:30.539236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 158/305] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:30 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:30.546576 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:30.547190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:30.568205 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:30.568662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:30.569453 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:30.569896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:30.737997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:30.745934 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35299515-55f8-47a5-80ea-75ed8f22f13b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.205245 Jun 24 04:19:30.746698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 159/306] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:30 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:31.550022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:31.550769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:31.557828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:31.558308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:31.559114 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:31.559543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:31.764358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:31.782085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:31.784259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:31.786354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c72da6a1-e632-4bf4-a703-79699ec71de9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.240447 Jun 24 04:19:31.787121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 160/307] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:31 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:31.795664 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:31.796662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:31.805293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:31.805963 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:31.806969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:31.807652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:31.990515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:32.003300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9b0018f4-97cf-40ca-8ca0-97fef33654a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.214632 Jun 24 04:19:32.013662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 161/308] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:31 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:32.029136 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce4ebcb5-d13a-4ca3-beb8-cd2d63c2e723 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:32.042840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce4ebcb5-d13a-4ca3-beb8-cd2d63c2e723 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:32.044804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce4ebcb5-d13a-4ca3-beb8-cd2d63c2e723 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:32.134220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ce4ebcb5-d13a-4ca3-beb8-cd2d63c2e723 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Going to try to stop instance {{(pid=118331) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 04:19:32.439203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ce4ebcb5-d13a-4ca3-beb8-cd2d63c2e723 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action" status: 202 len: 0 microversion: 2.1 time: 0.419986 Jun 24 04:19:32.444659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 162/309] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:19:32 2022] POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:19:32.450133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:32.451083 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:32.467301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:32.467301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:32.467301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:32.467301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:32.582142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] validate_networks() for [('a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:19:32.728934 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:32.743789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9884836c-8050-4bd4-b04d-f284aab23d7a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.295542 Jun 24 04:19:32.744459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 163/310] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:32 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:32.805463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:32.807016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:32.830101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:32.831167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:32.832243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:32.835847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:33.074853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:33.088469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:33.090093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:33.095940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5903135f-5a38-4327-be96-c4930d31e13f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.293177 Jun 24 04:19:33.109854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 164/311] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:32 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:33.121115 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:33.124057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:33.136508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:33.136954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:33.139225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:33.139658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:33.405012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:33.415193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6ad65cf2-efac-4329-bc95-b787e4356b68 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.303692 Jun 24 04:19:33.416382 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 165/312] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:33 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:33.762183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:33.763005 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:33.786449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:33.786944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:33.787786 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:33.788225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.158250 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:19:34.159111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:19:34.159251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:19:34.160338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:19:34.160959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:19:34.179609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.180383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.183556 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.184391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.239621 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:34.242796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.254158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:34.262134 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0e13ced5-219b-4abf-ba8f-6c2ac6023503 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.504870 Jun 24 04:19:34.263178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 166/313] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:33 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:34.270302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:34.277055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:34.285057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.285528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.286295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.288360 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.320774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:19:34.328000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:19:34.539258 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-21530596-cdf9-48e5-bfb8-3311a6a098e3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.977438 Jun 24 04:19:34.540827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 148/314] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:19:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 4983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:19:34.547696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:34.548672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:34.556060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.556844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.557849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:34.558530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:34.578315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.609125 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.620344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.627068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f4a04701-1d18-400e-81b8-72ab547ddd15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.362519 Jun 24 04:19:34.627766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 167/315] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:34 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:34.643135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6ca8bc70-e0cb-4cf8-b7bd-183fe7cdbac6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:34.644249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6ca8bc70-e0cb-4cf8-b7bd-183fe7cdbac6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:34.759515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6ca8bc70-e0cb-4cf8-b7bd-183fe7cdbac6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.768955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6ca8bc70-e0cb-4cf8-b7bd-183fe7cdbac6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1241 microversion: 2.1 time: 0.138888 Jun 24 04:19:34.771298 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 168/316] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:34 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:34.892443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:34.903166 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b169fc29-d047-4310-9b6c-6e5ac911958c tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.360940 Jun 24 04:19:34.909218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 149/317] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:34 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:35.282547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:35.285870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:35.298540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.299598 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:35.300684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.301342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:35.506313 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:35.515222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-28fb3e2e-76dd-4cf3-8a39-f144d7eca70d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.237840 Jun 24 04:19:35.516437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 169/318] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:35 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:35.652897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:35.658956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:35.671212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.671875 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:35.672835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.673512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:35.788713 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d23530c2-d8ed-404e-89c2-0cddaa70bc87 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:35.789342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d23530c2-d8ed-404e-89c2-0cddaa70bc87 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:35.912697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d23530c2-d8ed-404e-89c2-0cddaa70bc87 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:35.922426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d23530c2-d8ed-404e-89c2-0cddaa70bc87 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1241 microversion: 2.1 time: 0.137605 Jun 24 04:19:35.922915 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 170/319] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:35 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:35.933930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:35.935921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:35.947367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.950866 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:35.951732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:35.952342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:36.129779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:36.141707 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:36.143669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:36.145923 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-824989e7-88f5-4592-a7ea-fe42187505a6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.503707 Jun 24 04:19:36.159031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 150/320] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:35 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:36.202418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:36.212479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8048c60b-501d-456d-a3c3-99d2c5cc53a3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.284140 Jun 24 04:19:36.213207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 171/321] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:35 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:36.534349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:36.535294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:36.543120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:36.544628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:36.546133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:36.547080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:36.739009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:36.748854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-33cd520b-890d-41b6-9cd1-c2a71383c7a3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.219097 Jun 24 04:19:36.749392 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 151/322] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:36 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:36.939985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:36.940630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:36.947428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:36.948255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:36.949207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:36.949640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.021842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.036571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45369e0d-1d7f-42d2-a7be-bb2e3b5b3e37 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1237 microversion: 2.1 time: 0.100368 Jun 24 04:19:37.037148 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 172/323] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:36 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:37.165134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:37.166260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:37.178535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.178535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.178535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.178535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.233757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:37.233757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:37.255223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.258037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.258037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.258037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.424207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.434054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.436640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.438114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2524d713-3693-4591-a482-fcf5fecef8ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.276814 Jun 24 04:19:37.446737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 152/324] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:37 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:37.488646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.501403 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2edc3759-8219-405a-8028-71c51e05122d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.272967 Jun 24 04:19:37.502151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 173/325] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:37 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:37.770215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:37.770944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:37.777403 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.777842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.779689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:37.780086 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:37.918847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:37.931891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d69cf6d0-6dd3-40c9-be1f-13633ecf2283 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.170330 Jun 24 04:19:37.932634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 153/326] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:37 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:38.056709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:38.065732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:38.065732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.065732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.066187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.066649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.086014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:38.155500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:38.163969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-22168c04-bb03-4f3b-be37-893f16877329 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1301 microversion: 2.1 time: 0.111129 Jun 24 04:19:38.181575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 174/327] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:38 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:38.271140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1331063985", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "networks": [{"uuid": "1c845f89-b174-484c-b799-d73e1f1596bc"}]}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:38.461615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:38.462658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:38.473178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.473889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.475234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.475659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.650721 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:38.660427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:38.661964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:38.663281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9ca04de1-8db7-4b3b-8999-604ec020050e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.210012 Jun 24 04:19:38.663865 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 175/328] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:38 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:38.668500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:38.669341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:38.681550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.682203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.683166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.683752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.933467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:38.942817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9d63264-376f-49d5-8795-ccbb8ed781af tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.277610 Jun 24 04:19:38.948735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 176/329] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:38 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:38.954523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:38.955363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:38.963120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.963887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:38.964908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:38.965333 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.226553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:39.239891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fc4db74f-dddd-4fd3-87c3-32bd671d4660 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.287146 Jun 24 04:19:39.240553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 177/330] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:38 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:39.260092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:39.263293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:39.275183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.277178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.279267 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.281509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.329001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] validate_networks() for [('1c845f89-b174-484c-b799-d73e1f1596bc', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:19:39.534755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:39.547500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ccd43f1b-c715-4776-8bc0-cded3c5aa166 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.295555 Jun 24 04:19:39.548830 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 178/331] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:39 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:39.683003 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:39.683785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:39.696867 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.700962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.701637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.702162 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.885124 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:19:39.885640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:19:39.886854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:19:39.889530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:19:39.894498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:19:39.928510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.929145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.931641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:39.933937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:39.977360 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Getting quotas for project 46222aa2184c4a6d82b65d3c703c8bd7. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:39.983063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Getting quotas for user 8c6ef9f5f6ac4b6289aa1aa9e16ce4bb and project 46222aa2184c4a6d82b65d3c703c8bd7. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:40.001528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:19:40.004852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:19:40.061613 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.072058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.073551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.074958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-38df6207-18a5-449f-a050-0bb03fdb2ab1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1744 microversion: 2.20 time: 0.395860 Jun 24 04:19:40.082761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 179/332] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:39 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1744 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:40.086693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:40.087937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:40.101961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.102431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.105410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.106164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.158922 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ab2628b2-7abe-43fc-b13e-9b784db77a16 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885257 Jun 24 04:19:40.160715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 154/333] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:19:40.184176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-09b759bf-49e0-452f-8515-681786f94537 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:40.189498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-09b759bf-49e0-452f-8515-681786f94537 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:40.300957 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-09b759bf-49e0-452f-8515-681786f94537 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.310201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-09b759bf-49e0-452f-8515-681786f94537 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1214 microversion: 2.1 time: 0.138230 Jun 24 04:19:40.316302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 155/334] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:40 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:40.338283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.345927 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:40.350391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1e7c5c4e-9637-45ce-90ec-5f7077a28ff9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.269669 Jun 24 04:19:40.351010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 180/335] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:40 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:40.358846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:40.393989 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.394604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.395704 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.396544 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.423732 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:40.565465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:40.566798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:40.574274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.575824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.576858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.577505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:40.633842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.648965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-248d87f5-06a3-4a6c-b873-a0448fae2510 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.331328 Jun 24 04:19:40.652699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 156/336] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:40 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:40.760880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:40.771422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-88a5ca17-2a91-4ace-a9bf-058db98d0d9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.209962 Jun 24 04:19:40.773069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 181/337] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:40 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:40.964481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-8a8ea30c-6fa6-494e-9ad4-eaedf441294c req-704ac11d-3116-4545-a2c5-631e1ca3d150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1608c2b-a5ad-45f3-8e24-790fd53cbe49", "tag": "337acde5-acd2-490f-b729-39d3e95ad6d4"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:40.974508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8a8ea30c-6fa6-494e-9ad4-eaedf441294c req-704ac11d-3116-4545-a2c5-631e1ca3d150 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:40.975166 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8a8ea30c-6fa6-494e-9ad4-eaedf441294c req-704ac11d-3116-4545-a2c5-631e1ca3d150 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.000137 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-8a8ea30c-6fa6-494e-9ad4-eaedf441294c req-704ac11d-3116-4545-a2c5-631e1ca3d150 service nova] Creating event network-changed:337acde5-acd2-490f-b729-39d3e95ad6d4 for instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 on hv-cinder-84684 Jun 24 04:19:41.007070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-8a8ea30c-6fa6-494e-9ad4-eaedf441294c req-704ac11d-3116-4545-a2c5-631e1ca3d150 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Jun 24 04:19:41.007924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 157/338] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:41.099108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:41.099950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:41.108851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.109662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.110709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.111371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.329292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ae335eb8-6de0-4f23-a13f-a95896e74bcb tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:41.329292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ae335eb8-6de0-4f23-a13f-a95896e74bcb tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:41.433940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ae335eb8-6de0-4f23-a13f-a95896e74bcb tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:41.443358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ae335eb8-6de0-4f23-a13f-a95896e74bcb tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1214 microversion: 2.1 time: 0.119462 Jun 24 04:19:41.443936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 158/339] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:41 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:41.461241 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:41.461854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:41.488696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.489446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.490221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.490830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.705015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:41.728725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-eff107c0-0993-4a7c-93bd-5ffcc2470787 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.279832 Jun 24 04:19:41.735412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 159/340] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:41 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:41.735572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:41.736995 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:41.737663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:41.744722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.745180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.746000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.746508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.755650 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:41.757108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:41.758711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-670adaa0-07ef-4c29-942a-cc18c1972ff6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1744 microversion: 2.20 time: 0.664526 Jun 24 04:19:41.759280 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 182/341] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:41 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1744 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:41.789076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:41.789966 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:41.811516 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.812432 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:41.813405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:41.813843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.029806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.050259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b623120d-0362-49b2-bcac-f1ff09299ac2 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.318090 Jun 24 04:19:42.051226 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 160/342] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:41 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:42.118847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.127906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cbc8f21b-609b-4e08-8a41-a8cf02404757 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.342556 Jun 24 04:19:42.138483 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 183/343] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:41 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:42.461929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:42.462959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:42.477321 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.477856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.478742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.479703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.560612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.568225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4d8194d2-a012-4f8d-8979-843215966f8b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1210 microversion: 2.1 time: 0.110318 Jun 24 04:19:42.568771 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 161/344] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:42 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:42.750715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:42.751971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:42.760793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.761742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.763362 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.764023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.778011 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:42.781535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:42.790185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.790737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.791573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:42.792069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:42.928434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.940244 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-761c3663-54d7-4e96-a34d-66395973bab5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.193323 Jun 24 04:19:42.942763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 184/345] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:42 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:42.960519 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.970066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.974611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:42.974611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6fb1f0e5-2157-46d5-b40c-b27ae695e842 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.199654 Jun 24 04:19:42.974611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 162/346] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:42 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:43.068055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:43.068657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:43.078010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.078752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.079677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.080287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.146419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:43.147567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:43.155425 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.155782 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.156551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.156976 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.269909 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:43.300790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e94abcfc-3fba-4e0e-bc9b-0ee83e6e2526 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.236612 Jun 24 04:19:43.304942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 185/347] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:43 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:43.355383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:43.364648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1ac2af36-f106-44cf-86ad-78175fbaa674 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.221201 Jun 24 04:19:43.380657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 163/348] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:43 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:43.597828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:43.598570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:43.608752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:43.611908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.612590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.613904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.614566 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.724498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:43.741616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0dbf1d09-f881-4e8e-9f79-8611fccec1b5 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1266 microversion: 2.1 time: 0.149947 Jun 24 04:19:43.743740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 186/349] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:43 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:43.836951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-cd67bc91-7649-4684-badb-aa6d494dbd76 req-bad1160a-db85-487c-bf7e-737f736f1229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "name": "network-vif-plugged", "status": "completed", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:43.851637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-cd67bc91-7649-4684-badb-aa6d494dbd76 req-bad1160a-db85-487c-bf7e-737f736f1229 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.853062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-cd67bc91-7649-4684-badb-aa6d494dbd76 req-bad1160a-db85-487c-bf7e-737f736f1229 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.894900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-cd67bc91-7649-4684-badb-aa6d494dbd76 req-bad1160a-db85-487c-bf7e-737f736f1229 service nova] Creating event network-vif-plugged:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:19:43.900955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-cd67bc91-7649-4684-badb-aa6d494dbd76 req-bad1160a-db85-487c-bf7e-737f736f1229 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067581 Jun 24 04:19:43.907280 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 164/350] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:43.958029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:43.959551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:43.967054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.967716 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.968682 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:43.969266 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:43.995765 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:43.996762 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.009375 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.010056 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.013171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.014861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.301547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.311192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.315904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4b7152e6-45fb-4b80-8ff5-b9a7fc4961c9 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1502 microversion: 2.1 time: 0.361894 Jun 24 04:19:44.316481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 187/351] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:43 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1502 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:44.320705 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.322870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:44.323591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.324197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.326039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-20eac870-527e-49b9-bb6d-e3406be36b8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.336848 Jun 24 04:19:44.334756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 165/352] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:43 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:44.339848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26217b90-bf46-4654-a5b1-000faa94bd07"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:44.341086 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.343178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.343728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.344727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.345232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.350147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.350756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.351736 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.352322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.379393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] HTTP exception thrown: Cannot 'attach_volume' instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 while it is in vm_state rescued Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Request method failure captured: Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/os-volume_attachments HTTP/1.1 Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 74 Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrfLeDs0YL0BnbM5EotfCr5iI8_vDun375_cszEgc4ui957KxXPLQy5zow7Mw244spOHbzeumdoLBKzZ6UmFdV516OR-bkvT0xWTgqkx1TNhDbUR9BqX5ssWgqCa_DGRPGkn-yJ2Vh5I6VsfaveJuQnEUQFevsw7KKWUonMn84Jo_k Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:19:44.381633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96e2b5a124bf48fd82e48ed79aa4eeed"}]}] Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b158078d039a4979a9c0cf2be26c4b14 Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {"volumeAttachment": {"volumeId": "26217b90-bf46-4654-a5b1-000faa94bd07"}} Jun 24 04:19:44.383237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Cannot 'attach_volume' instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 while it is in vm_state rescued Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'server_id': 'ab22e349-8bc5-4678-979e-0db7dfcfdb29', 'body': {'volumeAttachment': {'volumeId': '26217b90-bf46-4654-a5b1-000faa94bd07'}}} Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:19:44.384190 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 while it is in vm_state rescued Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:19:44.385570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:19:44.387140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:19:44.387140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:19:44.387140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 while it is in vm_state rescued Jun 24 04:19:44.387140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:19:44.387140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Returning 409 to user: Cannot 'attach_volume' instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 while it is in vm_state rescued {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:19:44.389022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-431d1a39-668c-4df4-a77f-40b35795c24f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053149 Jun 24 04:19:44.389984 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 166/353] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:19:44 2022] POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 04:19:44.394890 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:44.395614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.402812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.404013 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.404887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.405424 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.523767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.535700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8ec7f282-692c-436e-8001-97d067a0b84a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.217953 Jun 24 04:19:44.536603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 188/354] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:44 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:44.541612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:44.542445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.550081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.550894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.551922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.552552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.591411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.601898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-56a828d6-c51c-4a74-88f3-767ee911f630 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.210614 Jun 24 04:19:44.604116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 167/355] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:44 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:44.759084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:44.760129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.776444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.777223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.780247 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.780909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.841102 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab7709ca-26a4-4e15-bf92-05b5ac065536 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/action" status: 202 len: 0 microversion: 2.1 time: 0.303040 Jun 24 04:19:44.842235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 189/356] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:19:44 2022] POST /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:19:44.850956 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:44.851967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:44.867170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.873446 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.876345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:44.876960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:44.891342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:44.896041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:44.916028 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f4d651a6-ff15-41c9-867e-e7d1e9573d43 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1274 microversion: 2.1 time: 0.160863 Jun 24 04:19:44.917250 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 168/357] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:44 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:45.174237 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:45.182062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-509b3a68-3beb-4047-9762-d2fee8d97be3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1510 microversion: 2.1 time: 0.335366 Jun 24 04:19:45.189050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 190/358] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:44 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:45.348491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:45.349345 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:45.371125 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.372680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:45.376357 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.379311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:45.584961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:45.585769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:45.601459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.603944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:45.605031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.610969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:45.865050 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:45.883018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:45.885706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:45.887378 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-327dd82a-88bb-468a-a8f3-10888fac8aff tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.547926 Jun 24 04:19:45.905852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 169/359] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:45 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:45.924579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:45.931184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:45.931811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:45.963372 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.965080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:45.969687 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:45.974828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.044301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:46.055317 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6fd76891-a4d0-4d5c-9a44-744d05777f0c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.481485 Jun 24 04:19:46.062311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 191/360] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:45 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:46.071436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:46.074680 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:46.088749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.089523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.094046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.094775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.355388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:46.355388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-86e0695e-4f12-45b2-942e-e5e79a3783dc tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1284 microversion: 2.1 time: 0.172229 Jun 24 04:19:46.355388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 192/361] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:46 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:46.355388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:46.357130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:46.357130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.357130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.357130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.357591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.357789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:46.357789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e54a6e72-1bc5-44f0-b2ba-3d2b5e1f6b33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.418749 Jun 24 04:19:46.357789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 170/362] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:45 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:46.544769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:46.552807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bd704061-9e21-472c-a59f-ab0d7080fe8f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1510 microversion: 2.1 time: 0.302626 Jun 24 04:19:46.553378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 193/363] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:46 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:46.911342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:46.914257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:46.918245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:46.923272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.924047 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:46.925292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:46.926038 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.053245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1703490451", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-158798097", "security_groups": [{"name": "tempest-secgroup-smoke-1573854686"}], "networks": [{"uuid": "73023663-c454-4d4f-aaaf-a748940b4903"}], "block_device_mapping_v2": [{"uuid": "f80b1232-18ea-4e61-8940-36053c3a64d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:47.216427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:47.226411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:47.228935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:47.234580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0474360a-4cae-4b6d-8c61-5308f79b1f91 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.328637 Jun 24 04:19:47.245912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 171/364] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:46 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:47.257505 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:47.259323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:47.274447 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.275879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.281857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.281857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.518931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:47.531094 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-297a034e-37be-45bc-82a3-f52dce9da5e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.283892 Jun 24 04:19:47.531854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 172/365] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:47 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:47.544341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:47.545476 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:47.552723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.553515 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.554613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.555251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.657209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:47.667340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4da85cdb-5cf6-4a29-b85b-7d737065dbee tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1272 microversion: 2.1 time: 0.134166 Jun 24 04:19:47.668827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 173/366] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:47 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:47.673818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:47.674458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:47.688858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.690350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.691432 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:47.691885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:47.784188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] validate_networks() for [('73023663-c454-4d4f-aaaf-a748940b4903', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:19:48.008633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.023744 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a37b9bde-8bdb-497e-8b6d-50a5958e2937 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.350145 Jun 24 04:19:48.023996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 174/367] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:47 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:48.040524 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:48.041198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:48.049350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.049865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.050786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.051244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.323381 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.327276 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:48.331583 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-96f4d0fa-14c7-4b49-842d-c8d63892e510 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1510 microversion: 2.1 time: 0.306114 Jun 24 04:19:48.333284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 175/368] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:48 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:48.346334 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:48.346998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:48.357339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.357900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.358789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.359293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.529026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.536963 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.538486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.539642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-78e30e66-24dd-4ae0-95ae-e6cdbaaa0c7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.200142 Jun 24 04:19:48.540191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 176/369] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:48 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:48.556254 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:48.557011 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:48.564145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.564477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:19:48.564592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.565048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:19:48.565342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.565527 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:19:48.565774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.565936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:19:48.566347 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:19:48.575861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.576310 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.577111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.577549 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.594551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Getting quotas for project 7e75e404ef4f4118a95ca8fb8d98becd. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:48.598560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Getting quotas for user f3821e46c09b449d85c46c58d99bf607 and project 7e75e404ef4f4118a95ca8fb8d98becd. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:48.662327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:19:48.664533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f80b1232-18ea-4e61-8940-36053c3a64d6',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:19:48.752848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:48.758437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-83e9527c-563f-4032-be7b-4f0f5065ab7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1722 microversion: 2.1 time: 0.205925 Jun 24 04:19:48.759025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 177/370] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:48 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:48.764392 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:48.765604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:48.774452 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.774910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:48.775696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:48.776128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.003196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:49.025027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a1a7a4ef-a91a-4ba4-a23b-d0ee66a3a088 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.264920 Jun 24 04:19:49.036550 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 178/371] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:48 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:49.045117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-da38b66a-d447-483a-8b7e-b049c7e6ae8b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'create', calling method: .version_select at 0x7fdfedbcf820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1236940011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbCevO/YiFCWUPUVJooCElSfF7zJ6v5V/49Zax9CbnfBAomeTyU0k9F7YF0NYeDh1cCpNshbAlD+2/hBVjp31wUukv4SCkAdWCGM5n7x36WP1gU5dI63kfJUX8gchOVw=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:49.068907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-da38b66a-d447-483a-8b7e-b049c7e6ae8b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Getting quotas for project d51a251ca7084b2bb07d808026cccd67. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:49.073482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-da38b66a-d447-483a-8b7e-b049c7e6ae8b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Getting quotas for user 4fb36d1e057543a3abcf6d6c2564d9ae and project d51a251ca7084b2bb07d808026cccd67. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:49.183569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-da38b66a-d447-483a-8b7e-b049c7e6ae8b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.144202 Jun 24 04:19:49.185609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 179/372] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:19:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:49.190221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:49.197162 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:49.211925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.214332 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.229675 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.231144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.247997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c5ed4af9-6878-414c-baa4-a0d853debf4e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.198184 Jun 24 04:19:49.251292 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 194/373] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:19:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:19:49.270035 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-631cebf1-d4e4-4b92-8779-57fd05e96523 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:49.270035 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-631cebf1-d4e4-4b92-8779-57fd05e96523 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:49.479610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-631cebf1-d4e4-4b92-8779-57fd05e96523 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:49.489271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:49.493334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-631cebf1-d4e4-4b92-8779-57fd05e96523 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1088 microversion: 2.1 time: 0.234114 Jun 24 04:19:49.493964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 195/374] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:49 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1088 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:49.506846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-166921654", "imageRef": "df4a2f30-367a-4534-a814-9f711898a7d0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1236940011", "networks": [{"uuid": "6f544842-0e73-4394-8265-69311b0ed02e"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:49.512663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f030d264-88d2-4616-ab99-89bc5895c92c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.321473 Jun 24 04:19:49.512663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 180/375] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:49 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:49.531681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:49.536864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:49.544176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.545022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.545956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.546619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.599947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] validate_networks() for [('6f544842-0e73-4394-8265-69311b0ed02e', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:19:49.732821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:49.744344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7c35d209-f6a4-432c-8755-0e82205c2b5b tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1516 microversion: 2.1 time: 0.232227 Jun 24 04:19:49.748114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 181/376] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:49 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:49.760219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:49.767075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:49.778548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.780942 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.782097 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:49.782654 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:49.956462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=4 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:50.005398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.018008 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.026953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.028841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9f19d7f6-8030-493f-9709-4351bb136228 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.279533 Jun 24 04:19:50.056062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 182/377] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:49 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:50.062548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:50.063324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:50.070018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.070630 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.071502 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.072031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.322327 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.333373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6ff6ee23-5a0a-4ea9-89e2-12fb8482324b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1699 microversion: 2.1 time: 0.275848 Jun 24 04:19:50.345951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 183/378] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:50 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1699 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:50.352540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:50.353802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:50.364448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.364900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.365669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.366094 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.464052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:19:50.464795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:19:50.466619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:19:50.467035 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:19:50.467445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:19:50.492204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.500705 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.502137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.508287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.578537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Getting quotas for project d51a251ca7084b2bb07d808026cccd67. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:50.586213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Getting quotas for user 4fb36d1e057543a3abcf6d6c2564d9ae and project d51a251ca7084b2bb07d808026cccd67. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:50.601933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:19:50.605475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df4a2f30-367a-4534-a814-9f711898a7d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:19:50.662418 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.673717 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-846dfb2b-c8bf-45c7-90b0-694db9f825ef tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.333201 Jun 24 04:19:50.674059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 184/379] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:50 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:50.682853 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-b333320b-d2da-424a-a18d-48171b9635b0 req-cbd89548-61f6-48d9-875c-f2025702ebf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1608c2b-a5ad-45f3-8e24-790fd53cbe49", "name": "network-vif-plugged", "status": "completed", "tag": "337acde5-acd2-490f-b729-39d3e95ad6d4"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:50.688889 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b333320b-d2da-424a-a18d-48171b9635b0 req-cbd89548-61f6-48d9-875c-f2025702ebf5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.689543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b333320b-d2da-424a-a18d-48171b9635b0 req-cbd89548-61f6-48d9-875c-f2025702ebf5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.709789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-b333320b-d2da-424a-a18d-48171b9635b0 req-cbd89548-61f6-48d9-875c-f2025702ebf5 service nova] Creating event network-vif-plugged:337acde5-acd2-490f-b729-39d3e95ad6d4 for instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 on hv-cinder-84684 Jun 24 04:19:50.716260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-b333320b-d2da-424a-a18d-48171b9635b0 req-cbd89548-61f6-48d9-875c-f2025702ebf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039887 Jun 24 04:19:50.717229 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 185/380] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:50.722909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-81579d14-fe52-4016-b957-1643c9a3d82d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:50.731362 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-81579d14-fe52-4016-b957-1643c9a3d82d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.731362 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-81579d14-fe52-4016-b957-1643c9a3d82d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.801103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-41a73258-1fda-441b-87dc-70317094f0ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304801 Jun 24 04:19:50.809191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 196/381] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:19:50.816985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-62088de8-52f1-4861-b7db-7b6b0546cdc7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:50.822636 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-81579d14-fe52-4016-b957-1643c9a3d82d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Going to try to start instance {{(pid=118330) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 04:19:50.822794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-62088de8-52f1-4861-b7db-7b6b0546cdc7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:50.890486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-62088de8-52f1-4861-b7db-7b6b0546cdc7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:50.899325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-62088de8-52f1-4861-b7db-7b6b0546cdc7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1088 microversion: 2.1 time: 0.087557 Jun 24 04:19:50.909210 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 197/382] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:50 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:50.913884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:50.914521 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:50.924705 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.925157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:50.928226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:50.928861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.123583 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.131946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f603a808-e83b-4adf-95da-b339f5143599 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.224276 Jun 24 04:19:51.132702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 198/383] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:50 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:51.139700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-91b96cb7-5e7e-4917-b212-24819485dff1 req-3eef0cdb-8f4e-452a-a4ea-18474a76141f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2068da-db6c-43af-b63c-e457cd427097", "tag": "2c487dac-5016-435d-bea6-beaa4600cdf6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:51.149354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-91b96cb7-5e7e-4917-b212-24819485dff1 req-3eef0cdb-8f4e-452a-a4ea-18474a76141f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.150129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-91b96cb7-5e7e-4917-b212-24819485dff1 req-3eef0cdb-8f4e-452a-a4ea-18474a76141f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.163609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-91b96cb7-5e7e-4917-b212-24819485dff1 req-3eef0cdb-8f4e-452a-a4ea-18474a76141f service nova] Creating event network-changed:2c487dac-5016-435d-bea6-beaa4600cdf6 for instance ce2068da-db6c-43af-b63c-e457cd427097 on hv-cinder-84684 Jun 24 04:19:51.172107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-81579d14-fe52-4016-b957-1643c9a3d82d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action" status: 202 len: 0 microversion: 2.1 time: 0.449742 Jun 24 04:19:51.172638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-91b96cb7-5e7e-4917-b212-24819485dff1 req-3eef0cdb-8f4e-452a-a4ea-18474a76141f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036402 Jun 24 04:19:51.172638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 199/384] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:51.177108 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 186/385] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:19:50 2022] POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:19:51.177287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d2d933be-72d2-4dee-95d6-1a3382a85ad6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:51.178174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d2d933be-72d2-4dee-95d6-1a3382a85ad6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:51.183386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:51.184150 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:51.191689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.192415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.193520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.194204 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.251517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d2d933be-72d2-4dee-95d6-1a3382a85ad6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.259476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d2d933be-72d2-4dee-95d6-1a3382a85ad6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1258 microversion: 2.1 time: 0.087352 Jun 24 04:19:51.260141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 200/386] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:51 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:51.265843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:51.267094 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:51.275778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.276229 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.279268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.279699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.393569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.403887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.406677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.407018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2ccaf4b2-c8b7-4670-aa44-08f60695667a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.228361 Jun 24 04:19:51.408408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 187/387] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:51 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:51.449070 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.458846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e171af02-3414-43a6-a8b1-d5fd1f4d6d5d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.197653 Jun 24 04:19:51.459840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 201/388] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:51 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:51.690978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:51.691374 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:51.698295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.698781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.701153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.701697 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.863024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:51.872004 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-874816cb-08dc-4d20-8439-e5e5fdf9b2aa tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.185414 Jun 24 04:19:51.875881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 188/389] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:51 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:51.915794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:51.916538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:51.924223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.924883 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.927360 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:51.927360 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:51.995571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.002893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-28209940-d21c-45db-b6ab-6fb2564b121d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1138 microversion: 2.1 time: 0.091017 Jun 24 04:19:52.004304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 202/390] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:51 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:52.150842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:52.151441 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:52.158780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.159437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.160581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.161173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.279239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:52.279870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:52.288253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.288455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.289222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.289671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.318743 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.333335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bb8ebf86-02ea-4e01-b4b5-e78d4874e030 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.186508 Jun 24 04:19:52.343309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 189/391] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:52 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:52.402139 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.421119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b55bf1a8-4f7d-4906-bbe4-304398de9f73 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1262 microversion: 2.1 time: 0.148015 Jun 24 04:19:52.425565 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:52.426183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:52.432976 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.433422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.434836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.435353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.435824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 203/392] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:52 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:52.480303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:52.480303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:52.484989 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.485654 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.489040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.489040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.669366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.681092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.684020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.685463 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ebed1ab9-46d7-415f-8e53-8ea94eb9413a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.263767 Jun 24 04:19:52.696848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:52.697093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 190/393] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:52 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:52.707305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f92502b9-0196-4806-ac77-3a273b839f3a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.234257 Jun 24 04:19:52.718727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 204/394] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:52 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:52.889158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:52.889794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:52.895977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.896421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:52.897183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:52.897871 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.020812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:53.021480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:53.028509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.028964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.029743 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.030235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.052469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.061448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5e171e38-0d33-4fbc-820a-97751be0e4b2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.176239 Jun 24 04:19:53.062328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 191/395] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:52 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:53.108928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.116448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a08b8763-ab1e-497a-940f-6d1f371af568 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1138 microversion: 2.1 time: 0.099716 Jun 24 04:19:53.117014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 205/396] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:53 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1138 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:53.351493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:53.351493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:53.359774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.360245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.361004 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.361439 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.451113 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:53.451989 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:53.459521 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.460214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.461152 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.461740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.544023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.552308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7c288839-24b3-4522-b125-b0674606f28b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.205954 Jun 24 04:19:53.558025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 192/397] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:53 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:53.565425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.572996 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9bdeb6e-c303-400f-8686-b94186f65e96 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1254 microversion: 2.1 time: 0.135212 Jun 24 04:19:53.573730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 206/398] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:53 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1254 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:53.704930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:53.705531 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:53.712253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.712541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.713278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.713707 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.719717 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:53.726171 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:53.726962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:53.740892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.743111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.743918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:53.744350 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:53.921809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.931493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.932988 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.934268 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f52f6501-71d2-4473-9c17-dfb9c6e982e8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.234823 Jun 24 04:19:53.945060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 193/399] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:53 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:53.945370 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:53.957197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b510df22-4f93-44d0-a7fd-6827eb18b84b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.235126 Jun 24 04:19:53.958475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 207/400] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:53 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:54.078926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:54.079532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:54.086233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.086714 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.087480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.087917 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.133775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:54.134395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:54.141339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.141782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.142573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.143003 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.207236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:54.219271 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8d7236da-34d3-48bc-b157-f2917ff4dbd7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1130 microversion: 2.1 time: 0.086650 Jun 24 04:19:54.223120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 208/401] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:54 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1130 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:54.254561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:54.262779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-78b3d290-1a0e-4f8a-b64a-120b78275909 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.187911 Jun 24 04:19:54.263358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 194/402] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:54 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:54.573343 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:54.574882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:54.582740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.583464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.584890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.585556 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.588863 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:54.589470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:54.598400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.598847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.599857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.600059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.790880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:54.827625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bb729da9-acc9-4836-9356-283f31737a8c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1254 microversion: 2.1 time: 0.242384 Jun 24 04:19:54.828287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 195/403] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:54 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1254 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:54.896129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6a2e49bb-f247-4f2e-adc7-fa6356ffa5fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: .version_select at 0x7fdfede4e940>, body: {"keypair": {"name": "tempest-keypair-808044917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF5q228J0gmiC6Bw70BcCdcGAsUKHuXYyb1I4mpsnJjGQrADRC/70QcaBmuS2lST+r/KxvpR7BSphYOP6efaMadbl4KkORwYw9Tjxnrmcf9btTQu4GoUtZ6fPkGTlu5Sw=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:54.915018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=25 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:54.923836 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:54.925843 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-6a2e49bb-f247-4f2e-adc7-fa6356ffa5fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:19:54.935500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-6a2e49bb-f247-4f2e-adc7-fa6356ffa5fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for user b158078d039a4979a9c0cf2be26c4b14 and project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:19:54.935982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b679f41e-c8cc-41e8-9875-6ca04e1c0051 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.367955 Jun 24 04:19:54.936756 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 209/404] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:54 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:54.954745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:54.957434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:54.961367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.961810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:54.962713 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:54.963143 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.029117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6a2e49bb-f247-4f2e-adc7-fa6356ffa5fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136335 Jun 24 04:19:55.036570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 196/405] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:19:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:55.044628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:55.047280 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:55.055118 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.055573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.057252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.057731 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.183195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.196332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.198149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.200619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-13479190-0af7-40cb-add6-404815dca9a0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.251842 Jun 24 04:19:55.202003 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 210/406] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:54 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:55.246257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:55.247798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:55.254254 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.255202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.256626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.256626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.280478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.292430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-78186f82-2889-4ce2-96d0-7faf5a36f471 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.253628 Jun 24 04:19:55.320329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 197/407] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:55 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:55.326725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:55.327438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:55.346651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.347211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.348092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.348645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.429490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.433218 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:55.438684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-63fe572f-18b4-4253-bc7b-0ccbdcd81bfa tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1186 microversion: 2.1 time: 0.196352 Jun 24 04:19:55.439454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 211/408] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:55 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1186 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:55.556148 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:55.564958 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-26683f56-bca9-45b4-b9f8-b5d968a5ae35 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.243137 Jun 24 04:19:55.565727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 198/409] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:55 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:55.846295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:55.846936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:55.861089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.867623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.877542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.879523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.952984 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:55.953993 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:55.978121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.978735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:55.986959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:55.987738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.032074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.040728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-72018d9e-8b24-49d9-acbe-20ec97aed8ce tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1310 microversion: 2.1 time: 0.199303 Jun 24 04:19:56.046069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 212/410] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:55 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:56.178192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.196734 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a809b41b-a464-4910-a3e9-9690cc2a1faa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1367 microversion: 2.1 time: 0.246354 Jun 24 04:19:56.199446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 199/411] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:55 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:56.218911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:56.220391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:56.226946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.232023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.234502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.235174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.317012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:56.318043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:56.326716 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.327507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.328528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.329183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.582507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.598124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.599851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.601332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ad966336-8703-4a6a-b5eb-94bd82d9d344 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.386442 Jun 24 04:19:56.612178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 213/412] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:56 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:19:56.612178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:56.612178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:56.612666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.620075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.620573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.622186 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.622680 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.622794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-abd37d58-1fdf-471c-8eeb-a9529743fc20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.307865 Jun 24 04:19:56.624568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 200/413] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:56 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:56.629430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:56.630036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:56.645645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.645645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.645645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:56.645645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:56.744222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:56.756364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a21afb42-db90-4db4-9b51-8258b20712f0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1194 microversion: 2.1 time: 0.153476 Jun 24 04:19:56.756994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 214/414] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:56 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:57.080629 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.081252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.101090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.101090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.101090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.101090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.211072 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:57.219857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a8632bfc-a4d9-4528-8033-5072b72f64a7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.595031 Jun 24 04:19:57.220445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 201/415] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:56 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:57.252968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.254608 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.263858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.264478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.265362 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.265898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.285037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:57.292913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a35cc047-852d-427c-9540-13876c778e3f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1328 microversion: 2.1 time: 0.216153 Jun 24 04:19:57.294043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 215/416] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:57.431008 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:57.440361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cbeef0cf-489d-4fd8-b1ca-08979bde7688 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1557 microversion: 2.1 time: 0.198310 Jun 24 04:19:57.440949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 202/417] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:57.458527 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.459041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.465952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.466439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.467344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.467784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.620705 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.622820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.630359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.630766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.631540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.631983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.641245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-48d673ed-76c9-4870-8ca7-e4bee1a046f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186802 Jun 24 04:19:57.642159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 216/418] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:57.653505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.654268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.656372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:19:57.661711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.662268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.663843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.663843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.913019 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:57.927590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fcf243ae-9b18-48f3-9a0f-24ffebd6560d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1708 microversion: 2.1 time: 0.278040 Jun 24 04:19:57.930103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 217/419] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1708 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:19:57.940647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:57.941257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:57.955063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.955999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:57.957145 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:57.957848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.123397 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.151067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6bfa8ae6-afde-4873-81f8-7ce644be112c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1204 microversion: 2.1 time: 0.211066 Jun 24 04:19:58.151067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 218/420] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1204 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:58.239596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:58.242050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:58.255060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.255547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.256325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.269268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.301212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.311132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.326683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.332725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0155df7e-1dc2-4423-a4a7-a817818e1e8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.716511 Jun 24 04:19:58.333422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 203/421] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:57 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:19:58.348253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:58.357074 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:58.390941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.391540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.392558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.392994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.622546 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.647164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1fa201b8-b234-4d8c-a667-be9e38f8338f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1316 microversion: 2.1 time: 0.312543 Jun 24 04:19:58.648231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 204/422] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:58 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:58.681993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:58.709208 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8af0d37b-c3ae-49bb-913c-7a2c496c9b1f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.473133 Jun 24 04:19:58.709838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 219/423] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:58 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:58.945518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:58.946337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:58.957632 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.961048 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:58.964260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:58.964959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.163281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:59.163281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:59.172540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.172988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.173840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.174322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.641895 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:59.651791 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d2568389-0a3f-4483-8531-229a71a30fac tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1712 microversion: 2.1 time: 0.710088 Jun 24 04:19:59.655078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 205/424] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:58 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1712 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:59.659653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-194852c6-628e-412e-b4a4-ec6031da6cea req-032fa5ff-61c1-4622-89b3-0a97bcaff823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2068da-db6c-43af-b63c-e457cd427097", "name": "network-vif-plugged", "status": "completed", "tag": "2c487dac-5016-435d-bea6-beaa4600cdf6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:19:59.671305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-194852c6-628e-412e-b4a4-ec6031da6cea req-032fa5ff-61c1-4622-89b3-0a97bcaff823 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.671755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-194852c6-628e-412e-b4a4-ec6031da6cea req-032fa5ff-61c1-4622-89b3-0a97bcaff823 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.683670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-194852c6-628e-412e-b4a4-ec6031da6cea req-032fa5ff-61c1-4622-89b3-0a97bcaff823 service nova] Creating event network-vif-plugged:2c487dac-5016-435d-bea6-beaa4600cdf6 for instance ce2068da-db6c-43af-b63c-e457cd427097 on hv-cinder-84684 Jun 24 04:19:59.688741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-194852c6-628e-412e-b4a4-ec6031da6cea req-032fa5ff-61c1-4622-89b3-0a97bcaff823 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032520 Jun 24 04:19:59.689647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 206/425] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:19:59.695031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:59.695937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:59.714408 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.715418 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.717850 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.718303 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.745019 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:19:59.761027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-29838151-6252-44e5-b755-602917561c9d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1272 microversion: 2.1 time: 0.602396 Jun 24 04:19:59.761526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 220/426] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:59 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1272 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:19:59.768905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:19:59.769768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:19:59.779710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.780197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:19:59.781030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:19:59.781468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.075667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:00.101035 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:00.102914 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:00.104128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1ace1501-d1d7-4fc8-945d-f106422e7dfb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.413073 Jun 24 04:20:00.115876 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 207/427] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:19:59 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:00.124573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:00.138721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:00.160585 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:00.160822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.161861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:00.170450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.456294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:00.471109 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1bc7a65a-f453-459b-a2fa-85eaadb6ee43 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.707224 Jun 24 04:20:00.473406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 221/428] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:19:59 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:00.540470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:00.558818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2cffcff1-0bce-4afb-b7db-78b6572e7dfd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.433325 Jun 24 04:20:00.577808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 208/429] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:00 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:00.779952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:00.781582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:00.796552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:00.796552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:00.796552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.796552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:00.797117 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.867981 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-95d7ab7b-c422-4d5e-8a12-3a24af3c7e15 req-3c927a38-bd4b-4f45-a6bf-f40984b460ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1608c2b-a5ad-45f3-8e24-790fd53cbe49", "tag": "337acde5-acd2-490f-b729-39d3e95ad6d4"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:00.893108 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-95d7ab7b-c422-4d5e-8a12-3a24af3c7e15 req-3c927a38-bd4b-4f45-a6bf-f40984b460ef service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:00.894159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-95d7ab7b-c422-4d5e-8a12-3a24af3c7e15 req-3c927a38-bd4b-4f45-a6bf-f40984b460ef service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:00.909285 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-95d7ab7b-c422-4d5e-8a12-3a24af3c7e15 req-3c927a38-bd4b-4f45-a6bf-f40984b460ef service nova] Creating event network-changed:337acde5-acd2-490f-b729-39d3e95ad6d4 for instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 on hv-cinder-84684 Jun 24 04:20:00.920121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-95d7ab7b-c422-4d5e-8a12-3a24af3c7e15 req-3c927a38-bd4b-4f45-a6bf-f40984b460ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057114 Jun 24 04:20:00.921434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 209/430] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:00.930606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1834047913", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ce8156e-f527-45c8-b424-190ecb88e595"}], "security_groups": [{"name": "tempest-securitygroup--376716350"}], "key_name": "tempest-keypair-808044917", "user_data": "}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:01.124340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] validate_networks() for [('8ce8156e-f527-45c8-b424-190ecb88e595', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:20:01.162532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:01.175735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66612c64-ba5b-4573-bbea-505163d56b91 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.400115 Jun 24 04:20:01.194172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 222/431] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:00 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:01.201459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:01.202570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:01.211723 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.212646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.213706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.214355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.282719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=18 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:01.546939 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:01.561785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:01.567428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:01.569722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a6805aae-f8ba-46a3-ad2f-01c6068294ba tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.373712 Jun 24 04:20:01.570761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 223/432] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:01 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:01.577121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:01.578041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:01.585874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.586667 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.587761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.588454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.614223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:01.786612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:01.797972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4b993687-4a94-45a6-9a64-365d930a11ba tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.225635 Jun 24 04:20:01.810489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 224/433] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:01 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:01.810489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-932c367e-a286-4dcd-af4b-ed4153a5ec11 req-4d2ab7d5-39b4-45a5-910d-039a67dd541a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:01.818025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-932c367e-a286-4dcd-af4b-ed4153a5ec11 req-4d2ab7d5-39b4-45a5-910d-039a67dd541a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.818569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-932c367e-a286-4dcd-af4b-ed4153a5ec11 req-4d2ab7d5-39b4-45a5-910d-039a67dd541a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.832884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-932c367e-a286-4dcd-af4b-ed4153a5ec11 req-4d2ab7d5-39b4-45a5-910d-039a67dd541a service nova] Creating event network-changed:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:20:01.837864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-932c367e-a286-4dcd-af4b-ed4153a5ec11 req-4d2ab7d5-39b4-45a5-910d-039a67dd541a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Jun 24 04:20:01.838492 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 225/434] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:01.846717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:01.847427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:01.855405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.856405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.857469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.858068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.940406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:20:01.942760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:20:01.943467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:20:01.944270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:20:01.944901 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:20:01.961668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.961668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.961668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:01.961668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:01.983325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:20:01.987737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Getting quotas for user b158078d039a4979a9c0cf2be26c4b14 and project 96e2b5a124bf48fd82e48ed79aa4eeed. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:20:01.999563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:20:02.001944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:20:02.021366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.032795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-832da133-a5c5-49a1-aa74-a58619a9127d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.191479 Jun 24 04:20:02.038802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 226/435] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:01 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:02.120129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3ab80196-7a61-4762-bdb7-1e760c3aa7bd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.196447 Jun 24 04:20:02.121925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 210/436] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:20:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:20:02.145876 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ad9042f0-0044-4159-98c7-515cb4cb9c26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:02.145876 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ad9042f0-0044-4159-98c7-515cb4cb9c26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:02.197194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:02.197942 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:02.205818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.207624 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.208760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.209538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.242569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ad9042f0-0044-4159-98c7-515cb4cb9c26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.252095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ad9042f0-0044-4159-98c7-515cb4cb9c26 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1245 microversion: 2.1 time: 0.123724 Jun 24 04:20:02.254606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 227/437] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:02 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:02.458101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.477626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-90cb073e-2358-4df9-b436-fc902cd7f0c2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.274792 Jun 24 04:20:02.477626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 211/438] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:02 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:02.589144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:02.590937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:02.599727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.600571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.601607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.602422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.747727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.757325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.758810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.760075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-31067b96-75e1-4f49-9ab2-89aae06d4a20 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.174663 Jun 24 04:20:02.767356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 228/439] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:02 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:02.817058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:02.820986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:02.823739 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.824973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.825983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.826696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.944135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-77a8519f-3bab-4884-9e56-a78aa43e1267 req-49ef4e43-8817-4e9c-b8f5-143b4c893e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:02.953277 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-77a8519f-3bab-4884-9e56-a78aa43e1267 req-49ef4e43-8817-4e9c-b8f5-143b4c893e86 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:02.953277 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-77a8519f-3bab-4884-9e56-a78aa43e1267 req-49ef4e43-8817-4e9c-b8f5-143b4c893e86 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:02.963455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-77a8519f-3bab-4884-9e56-a78aa43e1267 req-49ef4e43-8817-4e9c-b8f5-143b4c893e86 service nova] Creating event network-changed:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:20:02.968359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-77a8519f-3bab-4884-9e56-a78aa43e1267 req-49ef4e43-8817-4e9c-b8f5-143b4c893e86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027894 Jun 24 04:20:02.968961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 229/440] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:02.973729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:02.977193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:02.982834 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fba626f4-733f-4136-b7d3-2e4df0ad8320 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.169638 Jun 24 04:20:02.983396 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 212/441] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:02 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:03.051356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:03.052049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:03.060163 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.060608 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.061382 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.061810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.200955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.208412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bf5899d7-962d-4777-9949-dd917fe7867d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.161489 Jun 24 04:20:03.208982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 230/442] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:03 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:03.273903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:03.274542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:03.281082 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.281843 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.282344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.282807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.349184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.356755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02a66503-c92a-43ba-8e60-7d9efe1453dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.086930 Jun 24 04:20:03.357322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 213/443] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:03 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:03.485354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:03.485888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:03.492028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.492478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.493242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.493678 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.498280 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:03.623808 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.631305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-aac37bb7-d960-481d-a26e-5195fc3ad265 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.149957 Jun 24 04:20:03.631870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 231/444] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:03 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:03.778231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:03.778770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:03.784805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.785252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.786146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:03.786681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:03.941351 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.950240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.951673 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:03.953986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02878ed0-00ce-4dee-a569-d86c9a6db910 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.179701 Jun 24 04:20:03.954749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 214/445] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:03 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:04.000385 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:04.001311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:04.007786 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.008239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.009014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.009479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.146167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:04.157160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cab41c87-fd3e-4bed-ae94-0fc6f934105e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.161243 Jun 24 04:20:04.158056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 232/446] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:03 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:04.225442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:04.226513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:04.237186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.237711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.238591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.239085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.373540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:04.374154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:04.380191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:04.382026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.382950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.384909 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.385615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.390885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1a9923d3-c7aa-4237-a77f-26ccf16d2726 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.169492 Jun 24 04:20:04.391880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 215/447] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:04 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:04.475059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:04.481628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-af43e62c-e951-4e3e-a364-2c5a68ceec0e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.112244 Jun 24 04:20:04.482763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 233/448] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:04 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:04.650956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:04.651773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:04.660034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.660483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.661266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.661703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.817263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:04.825774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b7de6603-9732-4dc8-9b62-da8570218b64 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.180293 Jun 24 04:20:04.826356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 216/449] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:04 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:04.973281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:04.973795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:04.979858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.981069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:04.982301 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:04.982767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.135577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.152752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.152752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.161160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35be0c20-d559-4ed1-86e9-0b7f6e598a5b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.188227 Jun 24 04:20:05.161871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 234/450] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:04 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:05.174809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:05.175856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:05.182353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.184341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.184341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.184765 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.324096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.332001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3e02a992-93d9-4e5e-8909-249f4aa87b55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.161718 Jun 24 04:20:05.332558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 217/451] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:05 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:05.409137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:05.409917 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:05.416580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.417087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.418501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.418953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.502968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:05.514677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:05.514677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.514677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.514677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.515414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.571783 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.583025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0d79128f-551e-4c02-aa22-f59cad7a2a13 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.177819 Jun 24 04:20:05.590539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 235/452] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:05 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:05.603766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:05.611459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e1d28542-75de-4e1f-bfe1-90182ebd5dc8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.113078 Jun 24 04:20:05.612023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 218/453] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:05 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:05.843861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:05.844375 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:05.850969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.851406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:05.852169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:05.852592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.006578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.015871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5db8ad24-f40c-45a0-8f84-6235b3b7d562 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.177152 Jun 24 04:20:06.016444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 236/454] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:05 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:06.180667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:06.181277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:06.188508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.188955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.189746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.193020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.336636 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.346644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.348338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.349488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:06.349972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3572ee20-a8c1-42e0-b0d8-6e0e587cda5a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.172819 Jun 24 04:20:06.350170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:06.350507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 219/455] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:06 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:06.372638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.373117 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.374108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.374729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.524315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.532172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-72518c35-ed5d-42d5-b581-f2eff83ae6d6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.186777 Jun 24 04:20:06.532739 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 237/456] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:06 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:06.600262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:06.601181 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:06.607581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.608032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.608805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.609831 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.628195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:06.628894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:06.635366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.635891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.639002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:06.639640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:06.715913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.732107 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cc04dbd8-c4b6-46b7-97e9-5b54d86db704 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.107522 Jun 24 04:20:06.742940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 238/457] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:06 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:06.805755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:06.814293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-40fbf3c2-5d90-4e70-8ca3-46c39e76a829 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.217874 Jun 24 04:20:06.815235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 220/458] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:06 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:07.033948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:07.034985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:07.042123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.046239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.046239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.046239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.200897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.210182 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e1b6068-1559-4f20-950d-a9b192518dbe tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.180327 Jun 24 04:20:07.211049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 239/459] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:07 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:07.368953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:07.369634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:07.377431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.378065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.378855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.379286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.526209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.539118 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.540787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.542153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-858b2666-cb49-4d47-a619-e4fe80acb80d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.177293 Jun 24 04:20:07.543583 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 221/460] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:07 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:07.551804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:07.552827 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:07.564377 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.564824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.566973 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.567585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.719892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.729688 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-86cb03ce-649b-43db-98fc-42ce66e92205 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.182292 Jun 24 04:20:07.737644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 240/461] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:07 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:07.753393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:07.754143 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:07.760793 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.774787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.774787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.774787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.834522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:07.835409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:07.838648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:07.847581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.848297 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.848934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0137ca7d-e88f-49e8-a164-f4ac3021346e tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.099380 Jun 24 04:20:07.849544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:07.850148 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:07.850449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 222/462] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:07 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:07.992411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.000793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b1eebe7f-f23f-4572-a448-bf42fd94496e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.171941 Jun 24 04:20:08.001369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 241/463] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:07 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:08.229274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:08.229927 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:08.238764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.239395 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.240689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.241705 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.399055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.408535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0c5ea890-d3b2-4cab-940e-3b1cd205ccbc tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.183321 Jun 24 04:20:08.409311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 223/464] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:08 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:08.569445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:08.570108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:08.577026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.580464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.580464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.580464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.720665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.729221 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.731122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.732369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c1e9d2bf-6eac-4f5a-86e5-c06545cbbf4f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.167032 Jun 24 04:20:08.733201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 242/465] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:08 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:08.749537 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:08.750065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:08.756473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.757339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.758278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.758744 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.866762 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:08.868458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:08.877343 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.877975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.879325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:08.880091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:08.911513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:08.921686 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f1795d26-25ea-4a2c-9563-e97142dc8c41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.176412 Jun 24 04:20:08.932180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 224/466] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:08 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:09.018300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:09.019249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:09.059904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.062186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.062186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.062186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.195158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.204125 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-da4b1276-edea-4aaa-b836-7010b4522e4f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.341329 Jun 24 04:20:09.206411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 243/467] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:08 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:09.264136 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.275779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6d7451a1-b3ae-4e69-ac1e-646f37843742 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.258526 Jun 24 04:20:09.276513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 225/468] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:09 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:09.426905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:09.427564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:09.435013 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.435013 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.435619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.436145 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.591657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.598704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-30c5d8d3-b5f7-474b-aa18-ae89017d1c34 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.175628 Jun 24 04:20:09.599344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 244/469] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:09 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:09.752028 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:09.791672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:09.791672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.791672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.791672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.792082 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.924967 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.935955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.938700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:09.940128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3341e6bc-5414-4ebd-b36f-59be4fd1c685 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.192647 Jun 24 04:20:09.940273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:09.941092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:09.941276 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 226/470] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:09 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:09.956842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.957991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:09.959052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:09.959655 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.140973 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:10.149881 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-10a89721-bafe-49a2-b4c7-052aa92a1d07 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.214992 Jun 24 04:20:10.151263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 245/471] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:09 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:10.222314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:10.223246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:10.229443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.229989 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.231266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.231702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.294266 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:10.294930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:10.302913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.303330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:10.303470 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.304280 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.304717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.312103 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-edef5987-0d65-4de2-936e-c4e65ddbf6dd tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.094189 Jun 24 04:20:10.313035 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 227/472] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:10 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:10.451455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:10.459784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-77ec323f-c646-4bd6-a154-de911f942950 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.170193 Jun 24 04:20:10.460584 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 246/473] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:10 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:10.616075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:10.616840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:10.623591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.623987 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.624763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.625204 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.787649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:10.798995 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-24afe306-7cc1-454a-941e-cfe28157ba8e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.186389 Jun 24 04:20:10.809867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 228/474] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:10 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:10.960592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:10.961409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:10.968683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.972548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:10.972548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:10.972548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.155815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.159276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:11.168923 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:11.182782 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:11.183785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.183785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.183785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b866b404-fd0e-4686-96e9-9739f637d310 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.216762 Jun 24 04:20:11.184069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 247/475] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:10 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:11.184218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.184218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.184218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.184218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.206902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:11.340086 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:11.341174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:11.348561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.350279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.350279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.353863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.366676 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.375281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-866859d6-6a5a-408e-958a-1e119136601e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.211178 Jun 24 04:20:11.375849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 229/476] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:11 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:11.421175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.429619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d6e2d365-df2d-415c-bc93-ac06f3de7140 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.094117 Jun 24 04:20:11.430180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 248/477] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:11 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:11.479520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:11.480662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:11.487917 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.488213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.489084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.489499 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.632900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.642102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5d1c8625-efb5-45f9-9ca2-4f6510e8d766 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.165963 Jun 24 04:20:11.643072 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 230/478] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:11 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:11.816499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:11.817101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:11.823678 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.824369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.825129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:11.825562 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:11.966084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:11.974049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-afa3398d-6dbd-4949-90a9-43cbea411054 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.161460 Jun 24 04:20:11.974634 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 249/479] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:11 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:12.193031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:12.193652 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:12.195499 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:12.196176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=9 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:12.201529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.206657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.206657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.206657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.335453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.344183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.345690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.346946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cf98b3a6-3906-49a4-99ee-6b15c2bdad32 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.157757 Jun 24 04:20:12.347411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 231/480] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:12 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:12.392029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:12.392995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:12.395138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:12.400616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.401060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.402342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.403827 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.448559 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:12.449857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:12.456297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.456861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.458936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.460254 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.543990 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.552011 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b410a98e-9c7a-478c-ac71-95fbb61d7fe6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1249 microversion: 2.1 time: 0.107270 Jun 24 04:20:12.559896 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 232/481] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:12 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1249 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:12.581703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.589210 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b358b83a-4d35-48d4-af5f-a81cf527f198 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.200946 Jun 24 04:20:12.598401 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 250/482] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:12 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:12.664311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:12.664311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:12.666283 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.666905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.668293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:12.668719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:12.801214 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:12.808671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9f818e1b-6cd9-44a3-ae5d-fa39caf538b6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1314 microversion: 2.1 time: 0.153145 Jun 24 04:20:12.809222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 233/483] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:12 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:12.991494 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:12.992115 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:13.002245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.002798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.003657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.004164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.210839 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.219028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6c18eaf7-8608-4113-a563-9f8bfe39c91e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.231636 Jun 24 04:20:13.219847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 251/484] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:12 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:13.366725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:13.367549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:13.374999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.375453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.376428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.377723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.569864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:13.570796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:13.577845 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.578559 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.579336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.579946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.645445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.659625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06e41662-f9b7-44af-aca0-45eb19710269 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1241 microversion: 2.1 time: 0.094073 Jun 24 04:20:13.663848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 252/485] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:13 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:13.666387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:13.667380 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:13.675204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.675854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.676796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.677382 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.737098 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.750249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.750249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.750249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d5d1ee6d-db25-4ced-89e8-45515b5e68ec tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1739 microversion: 2.20 time: 0.387342 Jun 24 04:20:13.753969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 234/486] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:13 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:13.826297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:13.827037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:13.833471 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.833951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.834768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:13.835205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:13.890767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:13.898558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0b1e889e-1378-4615-9552-9fbb8e401b08 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.236741 Jun 24 04:20:13.899122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 253/487] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:13 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:14.024021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:14.032336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c1d05347-3de3-4068-a28b-cd103af9085b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1497 microversion: 2.1 time: 0.210972 Jun 24 04:20:14.032892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 235/488] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:13 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:14.237306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:14.238574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:14.247361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.247825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.248936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.249511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.486361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:14.494554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bd41b443-5541-4b69-aaaa-6e267cc77d7a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.261618 Jun 24 04:20:14.495263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 254/489] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:14 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:14.677444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:14.678144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:14.685410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.685876 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.686779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.687410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.769748 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:14.770758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:14.779201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.779907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.780903 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.781506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.813926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:14.822250 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-91d8787b-2189-47de-b30a-81bbcfb60e08 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1297 microversion: 2.1 time: 0.148970 Jun 24 04:20:14.823101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 236/490] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:14 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:14.924792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:14.925606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:14.935166 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.935166 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.936111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:14.940777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:14.997767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.010400 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.011929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.013922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a6076ba9-757d-4cda-82da-da0725a43b99 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1721 microversion: 2.20 time: 0.249060 Jun 24 04:20:15.023766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 255/491] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:14 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:15.028567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:15.030557 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:15.036339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.036788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.037558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.042419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.066310 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:20:15.364230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.372725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4891dad0-0442-4cfa-802d-c9b2e3732e24 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.455765 Jun 24 04:20:15.375825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 237/492] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:14 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:15.376062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0a57ebca-a05e-42cb-bdb4-f9550dadcd50 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 204 len: 0 microversion: 2.1 time: 0.348488 Jun 24 04:20:15.376062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 256/493] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:20:15 2022] DELETE /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:20:15.381745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:15.382509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:15.389310 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.389737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.390543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.390973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.514112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:15.514839 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:15.520905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.521352 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.522123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.522866 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.525253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.533536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0410362d-6914-4cfd-a2ec-08de9adc6abd tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1503 microversion: 2.1 time: 0.155493 Jun 24 04:20:15.534104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 238/494] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:15 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:15.657933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.665409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45a8fd7e-df19-4c8f-b601-8d93018a20c3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.156210 Jun 24 04:20:15.665974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 257/495] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:15 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:15.841810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:15.842589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:15.849263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.849719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.850531 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:15.851034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:15.920825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:15.928514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b6ca8829-ecd4-413d-be0d-8a656fdbf979 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1303 microversion: 2.1 time: 0.091376 Jun 24 04:20:15.929084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 239/496] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:15 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:16.032536 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:16.033138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:16.039220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.039691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.040439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.040861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.171981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.179784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.181273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.182469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-931e9107-fd97-4535-9154-fcca6bcf1d7f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1721 microversion: 2.20 time: 0.153952 Jun 24 04:20:16.183027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 258/497] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:16 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:16.390133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:16.390912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:16.396977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.397685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.398480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.398919 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.527974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.535657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7b4c554f-b1b0-40c3-b6f7-5f62ff4c6386 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.150028 Jun 24 04:20:16.536219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 240/498] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:16 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:16.551775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:16.552384 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:16.558806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.559253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.560635 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.561062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.682968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:16.683578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:16.690188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.690579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.690703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.691437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.691851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.698222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-026c8fd6-58d5-449d-8d22-bd3812cb89ae tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1503 microversion: 2.1 time: 0.150204 Jun 24 04:20:16.698820 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 259/499] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:16 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:16.822516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:16.830415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bd89d222-7471-4026-8678-e7fc402d9809 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.151208 Jun 24 04:20:16.830991 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 241/500] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:16 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:16.945217 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:16.945830 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:16.952234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.952947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.953894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:16.954534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:16.994963 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-c4617c49-4de9-4763-a264-184f95b48420 req-b20917c3-fcda-403c-8a91-83edb48f5ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "name": "network-vif-unplugged", "status": "completed", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:17.003880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c4617c49-4de9-4763-a264-184f95b48420 req-b20917c3-fcda-403c-8a91-83edb48f5ec2 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.004594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-c4617c49-4de9-4763-a264-184f95b48420 req-b20917c3-fcda-403c-8a91-83edb48f5ec2 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.017000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-c4617c49-4de9-4763-a264-184f95b48420 req-b20917c3-fcda-403c-8a91-83edb48f5ec2 service nova] Creating event network-vif-unplugged:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:20:17.025115 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.027041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-c4617c49-4de9-4763-a264-184f95b48420 req-b20917c3-fcda-403c-8a91-83edb48f5ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030846 Jun 24 04:20:17.027905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 242/501] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:17.035050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c0ff5d26-9e64-45d3-a0d6-ef0f65a9b325 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1303 microversion: 2.1 time: 0.093574 Jun 24 04:20:17.035841 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 260/502] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:16 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:17.201983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:17.202706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:17.208959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.209629 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.210416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.210855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.344079 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.352107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.353590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.354760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-061f3bf4-c0af-4f8d-9835-c7a83d75ab0d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1721 microversion: 2.20 time: 0.157547 Jun 24 04:20:17.360706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 243/503] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:17 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:17.552847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:17.553359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:17.560320 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.560905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.561656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.562085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.690260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.697725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-914c5f01-febb-4983-8021-4561d6cb096d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.148799 Jun 24 04:20:17.698286 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 261/504] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:17 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:17.715200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:17.715845 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:17.722035 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.724656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.724656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.724656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.847005 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:17.847537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:17.852329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.853556 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.854010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.854842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:17.855276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:17.861296 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7fb54795-d837-401e-9685-17a56d1aec06 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1503 microversion: 2.1 time: 0.149955 Jun 24 04:20:17.862057 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 244/505] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:17 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:17.991018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:17.994654 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:17.999207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5cc94bcf-a1d4-41b4-96ce-a9ad4ba49599 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.156240 Jun 24 04:20:17.999815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 262/506] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:17 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:18.052821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:18.053422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:18.059495 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.060396 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.061149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.061580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.120926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:18.128745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b2b8e4c9-e4aa-4ca5-b2ec-838deb3a4ef4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1303 microversion: 2.1 time: 0.079704 Jun 24 04:20:18.129328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 245/507] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:18 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1303 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:18.375802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:18.376573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:18.384861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:18.384861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.384861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.385164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.385467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.543690 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:18.552196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:18.553885 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:18.555083 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-296afa57-eed3-4a7f-b46c-86c9f5d91e1c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1721 microversion: 2.20 time: 0.185944 Jun 24 04:20:18.555641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 263/508] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:18 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:18.715348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:18.716431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:18.722916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.723365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.724153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.724577 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.879054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:18.879661 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:18.886837 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.887334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.888655 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:18.889188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:18.968307 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:18.972237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:18.977043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0f734cc5-6aca-44ff-80b9-ce4d33dd3700 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.265460 Jun 24 04:20:18.977915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 246/509] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:18 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:19.016621 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:19.017318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:19.023628 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.024073 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.024641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.026102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.026638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.034201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5f782887-647f-4bfb-9950-c5eb5f8c7da3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1503 microversion: 2.1 time: 0.159130 Jun 24 04:20:19.043426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 264/510] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:18 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:19.145110 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:19.145725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:19.152065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.152513 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.153812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.154247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.219583 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.226971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8bbb1ca5-becb-4a5d-b593-1cec8dfc075a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1303 microversion: 2.1 time: 0.085757 Jun 24 04:20:19.227532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 265/511] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:19 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:19.247242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.254921 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b363f502-f9de-4280-92ca-8becd9d47b90 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.243086 Jun 24 04:20:19.255746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 247/512] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:19 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:19.573883 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:19.574518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:19.582860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.583312 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.584092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:19.584526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:19.724212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.735396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.737437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:19.739189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-024b4ee4-6edd-422d-a802-d71e093b9814 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1721 microversion: 2.20 time: 0.169348 Jun 24 04:20:19.740197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 266/513] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:19 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:19.997640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:19.997640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.001848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.002291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.003078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.003508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.051278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:20.051920 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.058445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.058894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.059845 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.060324 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.201428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.209185 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-476f9d55-d3ce-4d62-986e-72c7d63e58a9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1503 microversion: 2.1 time: 0.161948 Jun 24 04:20:20.209757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 267/514] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:20 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:20.243643 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:20.244252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.250717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.251084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.251842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.252268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.375719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.386576 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cc97d4e5-4af8-46ca-b60a-102ad4c90dbc tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.396089 Jun 24 04:20:20.387602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 248/515] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:19 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:20.392342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:20.393239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.399385 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.399879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.400874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.401508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.404040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.412256 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-159b4bd9-b9e2-424e-a0cf-955076d4d2eb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.172351 Jun 24 04:20:20.412834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 268/516] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:20 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:20.417586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-26ca2468-1d97-4f62-9188-2893383fe94c req-b42f0979-ed7d-4f8a-99ad-a66b126c0efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2068da-db6c-43af-b63c-e457cd427097", "name": "network-vif-deleted", "tag": "2c487dac-5016-435d-bea6-beaa4600cdf6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:20.427964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-26ca2468-1d97-4f62-9188-2893383fe94c req-b42f0979-ed7d-4f8a-99ad-a66b126c0efb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.428413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-26ca2468-1d97-4f62-9188-2893383fe94c req-b42f0979-ed7d-4f8a-99ad-a66b126c0efb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.441707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-26ca2468-1d97-4f62-9188-2893383fe94c req-b42f0979-ed7d-4f8a-99ad-a66b126c0efb service nova] Creating event network-vif-deleted:2c487dac-5016-435d-bea6-beaa4600cdf6 for instance ce2068da-db6c-43af-b63c-e457cd427097 on hv-cinder-84684 Jun 24 04:20:20.446841 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-26ca2468-1d97-4f62-9188-2893383fe94c req-b42f0979-ed7d-4f8a-99ad-a66b126c0efb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032867 Jun 24 04:20:20.447640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 269/517] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:20.579513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.586939 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8e6141fc-a7ea-4e00-95a4-8303434157ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.198212 Jun 24 04:20:20.587492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 249/518] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:20 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:20.758863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:20.760215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.768151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.768861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.769640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.770071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.911704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.921741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.923314 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:20.924479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f774f5ee-b2a0-4438-acff-817406cb4522 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1664 microversion: 2.20 time: 0.169994 Jun 24 04:20:20.925032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 270/519] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:20 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:20.943485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cf5c601-1542-4adb-b7e6-b6b35b6ddf1c"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:20.944567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:20.950809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.951237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:20.951990 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:20.952416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.226180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:21.227112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:21.237378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.237378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.238033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.238525 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.321838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.322311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.322784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lazy-loading 'fault' on Instance uuid ce2068da-db6c-43af-b63c-e457cd427097 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:20:21.385578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:21.389224 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-51b92abd-7352-4018-945c-dceda2ebd77a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 200 len: 1304 microversion: 2.1 time: 0.166851 Jun 24 04:20:21.389811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 271/520] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:21 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:21.404384 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:21.404992 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:21.411434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.412728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.412728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.413043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.545066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:21.552579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4cbde0a7-9d1c-4771-b660-7b57429246ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.152540 Jun 24 04:20:21.553191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 272/521] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:21 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:21.557606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:21.558214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:21.565021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.565469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.566322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.566804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.733794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:21.741444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8da46813-e997-4454-9632-9d7b7f89820a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.187287 Jun 24 04:20:21.742208 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 273/522] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:21 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:21.746503 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:21.747187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:21.759818 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.760412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.761021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:21.761455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:21.924860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:21.935174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f3277289-f491-4270-94cd-35f812fd683e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.191186 Jun 24 04:20:21.942001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 274/523] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:21 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:22.099542 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-84d35922-6425-4073-89c8-8d3cebeb67b4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.159999 Jun 24 04:20:22.100248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 250/524] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jun 24 04:20:20 2022] POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 04:20:22.223619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:22.224184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:22.230481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.230929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.236413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.236413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.405799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:22.406451 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: ce2068da-db6c-43af-b63c-e457cd427097] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:22.412416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.412871 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.413627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.414068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.427713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] HTTP exception thrown: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Request method failure captured: Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 HTTP/1.1 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTtX5vvV26zetHM7LLnpDyF98CPt9XRGfpcg2PJO2KqeGxv2s-lM5BYQ_9811XkH_HayBjdwoElAw-Fn4EfMz_DpGgCdy8vpPEhGbjXRgfNtISDvWFi-GeGdjow6RYeVMgTUyFdAAtp2ms543xrrhMzptBrptPaCgAJbs_y9_xoMZwg Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 46222aa2184c4a6d82b65d3c703c8bd7 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:20:22.429335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46222aa2184c4a6d82b65d3c703c8bd7"}]}] Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 46222aa2184c4a6d82b65d3c703c8bd7 Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesActionsTest-2055076363-project Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 8c6ef9f5f6ac4b6289aa1aa9e16ce4bb Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesActionsTest-2055076363-project Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. Jun 24 04:20:22.430928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'ce2068da-db6c-43af-b63c-e457cd427097'} Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:20:22.432062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. Jun 24 04:20:22.433343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:22.434977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Returning 404 to user: Instance ce2068da-db6c-43af-b63c-e457cd427097 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:20:22.434977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7beda0fb-2bcc-4e7a-b2f8-db327bc946f3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097" status: 404 len: 111 microversion: 2.1 time: 0.028936 Jun 24 04:20:22.434977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 251/525] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:22 2022] GET /compute/v2.1/servers/ce2068da-db6c-43af-b63c-e457cd427097 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 04:20:22.463022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-29894f65-7b9e-4f47-8d73-8b3f8ca85529 req-4753e486-9873-436e-944d-e7dc4915c14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:22.471141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-29894f65-7b9e-4f47-8d73-8b3f8ca85529 req-4753e486-9873-436e-944d-e7dc4915c14a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.471577 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-29894f65-7b9e-4f47-8d73-8b3f8ca85529 req-4753e486-9873-436e-944d-e7dc4915c14a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.483269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-29894f65-7b9e-4f47-8d73-8b3f8ca85529 req-4753e486-9873-436e-944d-e7dc4915c14a service nova] Creating event network-changed:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:20:22.488645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-29894f65-7b9e-4f47-8d73-8b3f8ca85529 req-4753e486-9873-436e-944d-e7dc4915c14a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029163 Jun 24 04:20:22.489532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 252/526] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:22.494914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a1b6aac5-9419-49c4-ae15-a4c894fb6ad0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/action" status: 202 len: 0 microversion: 2.20 time: 0.275172 Jun 24 04:20:22.495644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 275/527] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jun 24 04:20:22 2022] POST /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:20:22.505972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:22.506698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:22.508689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:22.514031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.514527 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.515354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.515796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.546456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-484686289", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "networks": [{"uuid": "1c845f89-b174-484c-b799-d73e1f1596bc"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:22.601579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] validate_networks() for [('1c845f89-b174-484c-b799-d73e1f1596bc', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:20:22.660814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:22.670409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:22.672110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:22.673598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5b346542-7d72-4f45-80e4-0039c195aaab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1750 microversion: 2.20 time: 0.172498 Jun 24 04:20:22.674410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 253/528] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:22 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:22.689742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:22.690620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:22.697069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.697520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.698287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.698909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.852054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:22.860499 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-de401563-df7b-45f0-9397-219615cdab94 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.174390 Jun 24 04:20:22.861069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 254/529] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:22 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:22.865440 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:22.870117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:22.873263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.873724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.874539 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:22.874982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:22.989773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:20:22.989773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:20:22.990338 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:20:22.990621 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:20:22.991132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:20:23.001813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.002498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.004128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.004749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.025016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.027056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Getting quotas for project 46222aa2184c4a6d82b65d3c703c8bd7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:20:23.034271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4a7ea219-7935-41de-88ca-4108a43b9e74 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.172149 Jun 24 04:20:23.035188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 255/530] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:22 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:23.037008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Getting quotas for user 8c6ef9f5f6ac4b6289aa1aa9e16ce4bb and project 46222aa2184c4a6d82b65d3c703c8bd7. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:20:23.050099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:23.051004 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:20:23.051135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:23.053458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:20:23.057194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.057641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.058436 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.059039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.179994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-65cd7517-25b1-46fd-b4bd-fea0d8681bd6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638136 Jun 24 04:20:23.180957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 276/531] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:20:23.185788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-91688494-6bbe-430b-a4fa-ac44e0741970 req-d61f3128-65b6-48ad-926d-965d2dfbf14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "name": "network-vif-plugged", "status": "completed", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:23.195198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-91688494-6bbe-430b-a4fa-ac44e0741970 req-d61f3128-65b6-48ad-926d-965d2dfbf14f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.195699 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-91688494-6bbe-430b-a4fa-ac44e0741970 req-d61f3128-65b6-48ad-926d-965d2dfbf14f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.207724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.208327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-91688494-6bbe-430b-a4fa-ac44e0741970 req-d61f3128-65b6-48ad-926d-965d2dfbf14f service nova] Creating event network-vif-plugged:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:20:23.221262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0ef2ee1d-5145-4386-aae4-abbf4d3c1ec0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.173859 Jun 24 04:20:23.231671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-91688494-6bbe-430b-a4fa-ac44e0741970 req-d61f3128-65b6-48ad-926d-965d2dfbf14f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044810 Jun 24 04:20:23.231671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 277/532] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:23.234080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 256/533] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:23 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:23.238000 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-231b8f37-9390-4b81-9e2a-d0b01c362d89 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:23.238833 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-231b8f37-9390-4b81-9e2a-d0b01c362d89 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:23.297793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-231b8f37-9390-4b81-9e2a-d0b01c362d89 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.304338 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-231b8f37-9390-4b81-9e2a-d0b01c362d89 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1213 microversion: 2.1 time: 0.074470 Jun 24 04:20:23.305071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 278/534] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:23 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:23.697354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:23.697860 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:23.704337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.704790 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.705562 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.706053 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.877976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:23.878774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:23.887085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.888504 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.889290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:23.889733 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:23.964548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.989023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.992911 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:23.994121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8f025189-2529-4912-aae2-a2511b404968 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1750 microversion: 2.20 time: 0.300814 Jun 24 04:20:23.998676 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 257/535] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:23 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1750 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:24.053778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:24.054521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:24.058765 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:24.067936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5ec2e7ac-d0be-4159-8838-6e04a73a15a9 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.194337 Jun 24 04:20:24.072416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.072931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.073759 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.074415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.078028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 279/536] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:23 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:24.210556 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:24.218563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ee0b2e82-fd08-4a0a-9788-d0321677718d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.170210 Jun 24 04:20:24.219121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 258/537] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:24 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:24.238329 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:24.238952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:24.245095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.245534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.246284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.246740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.321055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:24.321828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:24.328330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.328848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.329682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:24.330117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:24.378467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:24.386193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0dc65b78-cc20-4d67-bb17-bc867e7c5e1d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.151732 Jun 24 04:20:24.386851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 280/538] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:24 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:24.390847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:24.398524 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-87cb7396-0f9f-487e-8253-a15bd974990b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1217 microversion: 2.1 time: 0.081356 Jun 24 04:20:24.399078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 259/539] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:24 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:25.012712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:25.013441 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:25.020500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.020940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.021693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.022144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.026412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:25.085078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:25.085715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:25.093639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.094090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.095037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.095696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.178962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.189093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.190687 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.191846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f324bb4b-608a-4213-af72-91cc808bbffd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1750 microversion: 2.20 time: 0.183258 Jun 24 04:20:25.192579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 281/540] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:25 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:25.234562 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.235303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:25.235921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:25.241938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.242411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.242855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d40ac295-42a5-4fb6-a5d1-b1b9e5bf7112 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.161504 Jun 24 04:20:25.243182 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.243557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 260/541] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:25 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:25.243694 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.380402 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.388957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4bb1565a-af4a-4f06-81e6-0fd257b62453 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.158320 Jun 24 04:20:25.389544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 282/542] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:25 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:25.402823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:25.404306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:25.410960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.414361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.414361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.414361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.415821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:25.416422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:25.425535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.425976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.426778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:25.427208 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:25.490857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.499299 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-aa16cd8b-c2c1-412b-b546-80d2145e8c87 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1209 microversion: 2.1 time: 0.087224 Jun 24 04:20:25.501808 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 283/543] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:25 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:25.557385 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:25.565184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-03015d14-067b-4978-b5c4-03dcd72a7449 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.166270 Jun 24 04:20:25.565750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 261/544] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:25 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:26.211111 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:26.211663 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:26.218247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.218724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.219480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.219912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.259881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:26.260487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:26.266640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.267081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.267846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.268277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.272343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:26.348387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.357782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.363508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.363508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f8bc595f-67df-4645-a0dd-71bd24fdd140 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1752 microversion: 2.20 time: 0.153362 Jun 24 04:20:26.363508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 284/545] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:26 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:26.406136 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:26.406766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:26.407290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.413821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.414337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.415066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.416106 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.426471 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ea0cc259-0c7b-48ed-8231-45ea5daa186d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1358 microversion: 2.1 time: 0.170164 Jun 24 04:20:26.434161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 262/546] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:26 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:26.517434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:26.518045 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:26.524874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.525322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.526200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.526690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.590270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.591082 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.598274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-17c03681-de6f-4fae-9797-ada2a28e90b7 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1209 microversion: 2.1 time: 0.085233 Jun 24 04:20:26.599323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 263/547] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:26 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:26.604161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:26.604764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:26.611264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.611704 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.612091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1f5917bb-1eb4-4b82-a9d5-1157a65748b1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.209917 Jun 24 04:20:26.612490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:26.612685 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 285/548] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:26 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:26.612930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:26.748069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:26.755554 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3db79d3e-c2a5-4d2e-b295-fef6f9229da3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.155216 Jun 24 04:20:26.756106 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 264/549] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:26 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:27.219379 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-add2e89f-ed11-4e81-880f-a2c4d2252ead req-040aa90d-8fa4-48df-ac50-6eecf6e6bd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "name": "network-vif-plugged", "status": "completed", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:27.228926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-add2e89f-ed11-4e81-880f-a2c4d2252ead req-040aa90d-8fa4-48df-ac50-6eecf6e6bd0c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.229399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-add2e89f-ed11-4e81-880f-a2c4d2252ead req-040aa90d-8fa4-48df-ac50-6eecf6e6bd0c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.241368 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-add2e89f-ed11-4e81-880f-a2c4d2252ead req-040aa90d-8fa4-48df-ac50-6eecf6e6bd0c service nova] Creating event network-vif-plugged:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:20:27.246205 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-add2e89f-ed11-4e81-880f-a2c4d2252ead req-040aa90d-8fa4-48df-ac50-6eecf6e6bd0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Jun 24 04:20:27.248060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 286/550] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:27.379325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.379846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.385926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.386395 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.387158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.388250 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.444539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.445269 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.452917 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.453370 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.454141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.454629 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.525780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.535236 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.538478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.539727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4f6a77cd-e2ce-4fd1-8502-abdde6ccb051 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1752 microversion: 2.20 time: 0.164507 Jun 24 04:20:27.540698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 265/551] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:27.594862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.602298 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-15cb1c9b-497d-469f-aed9-3d4254e4df92 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1547 microversion: 2.1 time: 0.162063 Jun 24 04:20:27.602887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 287/552] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:27.614153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.614782 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.618711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.619318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.621183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.621683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.623205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.623796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.627800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.628406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.629195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.629855 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.703224 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.712478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3882658d-bde4-470a-80c2-4c7c25d03324 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1265 microversion: 2.1 time: 0.102126 Jun 24 04:20:27.714436 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 266/553] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:27.726353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.727061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.734403 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.734842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.735625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.736061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.796009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:27.805074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e1cb0254-7933-41da-a7b7-df81ecf78ef6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1547 microversion: 2.1 time: 0.190197 Jun 24 04:20:27.806026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 288/554] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1547 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:27.811476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:27.812103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:27.818804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.819257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.823469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:27.823469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:27.996080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.005342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7aa1d358-f1f1-4a4c-9cc3-9cf7fc3aa41a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.198025 Jun 24 04:20:28.006942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 289/555] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:28.017397 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:28.022116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.023491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Searching by: {'deleted': False, 'project_id': 'd51a251ca7084b2bb07d808026cccd67'} {{(pid=118331) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 04:20:28.039118 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.039567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.045163 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.045616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.162410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.multi_cell_list [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 04:20:28.266914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-29152735-ff2b-43a5-9cef-febef002a2ff tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.258044 Jun 24 04:20:28.267570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 290/556] 10.222.0.16 () {58 vars in 1124 bytes} [Fri Jun 24 04:20:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:28.278797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:28.279488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:28.285522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.285971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.286863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.287302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.310440 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.331273 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-94639047-1107-4c91-bca1-f1b4e2fdb460 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.615417 Jun 24 04:20:28.331912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 267/557] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:27 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:28.429944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.437588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0420a5a3-f274-48ee-8d84-bcbbc1c1be9f tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1547 microversion: 2.1 time: 0.162672 Jun 24 04:20:28.438156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 291/558] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:28 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:28.559578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:28.560237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:28.569915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.570384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.571174 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.571613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.730804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:28.731518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:28.738019 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.738500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.740070 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:28.740510 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:28.815347 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.824510 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-36ca4906-fa85-4c51-b28d-05b6e59171c2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1271 microversion: 2.1 time: 0.097607 Jun 24 04:20:28.826602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 292/559] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:28 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:28.852815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.861485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.863338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:28.864627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6230f3f4-8c88-45ba-b854-5ddf039e193c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1752 microversion: 2.20 time: 0.309718 Jun 24 04:20:28.865367 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 268/560] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:28 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1752 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:29.023902 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:29.024539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:29.030969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.032129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.033001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.033573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.214282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:29.223007 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-182f8cba-3c58-4455-809f-3d0ca8b86ff4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.203176 Jun 24 04:20:29.232549 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 293/561] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:29 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:29.261458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-04dff8e1-04d9-40a1-95dd-0ef67dda062f req-9417e677-ec69-473b-9abc-fc11716c9801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "name": "network-vif-plugged", "status": "completed", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:29.269541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-04dff8e1-04d9-40a1-95dd-0ef67dda062f req-9417e677-ec69-473b-9abc-fc11716c9801 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.269979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-04dff8e1-04d9-40a1-95dd-0ef67dda062f req-9417e677-ec69-473b-9abc-fc11716c9801 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.281726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-04dff8e1-04d9-40a1-95dd-0ef67dda062f req-9417e677-ec69-473b-9abc-fc11716c9801 service nova] Creating event network-vif-plugged:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:20:29.286656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-04dff8e1-04d9-40a1-95dd-0ef67dda062f req-9417e677-ec69-473b-9abc-fc11716c9801 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028981 Jun 24 04:20:29.287670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 269/562] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:29.348582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:29.349198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:29.359638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.360071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.360892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.361290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.510709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:29.518850 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-53dde73f-5537-4134-8335-4feb4f157780 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1370 microversion: 2.1 time: 0.174203 Jun 24 04:20:29.519414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 294/563] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:29 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:29.844529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:29.845242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:29.852778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.853368 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.854151 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.854626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.887212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:29.887822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:29.894616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.895065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:29.895828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:29.896259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.055961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.065999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.067535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.068729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d82b58e3-3135-4335-a6ed-b5dee46ecd0a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.187797 Jun 24 04:20:30.080217 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 295/564] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:29 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:30.125194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.132459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-111d0dc1-d24d-4d4c-bb2e-db31530567e6 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.294214 Jun 24 04:20:30.133022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 270/565] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:29 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:30.239755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:30.240362 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:30.246414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.247532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.248478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.248907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.287291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-68ee39f4-ef27-40c6-a1e0-f4a1c273878b req-89659990-5aed-4cb5-80da-bba0858ff377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d33e27-a747-4178-b0e9-8b10ac11f4d2", "tag": "f515794a-f43b-43e2-8d02-230f5546e5d8"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:30.298311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-68ee39f4-ef27-40c6-a1e0-f4a1c273878b req-89659990-5aed-4cb5-80da-bba0858ff377 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.298703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-68ee39f4-ef27-40c6-a1e0-f4a1c273878b req-89659990-5aed-4cb5-80da-bba0858ff377 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.320960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-68ee39f4-ef27-40c6-a1e0-f4a1c273878b req-89659990-5aed-4cb5-80da-bba0858ff377 service nova] Creating event network-changed:f515794a-f43b-43e2-8d02-230f5546e5d8 for instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 on hv-cinder-84684 Jun 24 04:20:30.326908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-68ee39f4-ef27-40c6-a1e0-f4a1c273878b req-89659990-5aed-4cb5-80da-bba0858ff377 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043072 Jun 24 04:20:30.328046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 271/566] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:30.391996 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.400040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9d211db-dbc5-4da8-b11a-6ff261debfe1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.164042 Jun 24 04:20:30.400618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 296/567] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:30 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:30.401540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e0d886-5ab6-4880-b145-f66ec8f9a110"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:30.402740 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:30.408933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.409376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.410135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.410595 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.536671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:30.537271 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:30.543607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.544039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.544949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.545371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.689270 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:30.697009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1323d37a-4e16-4834-8fe4-50b2a3a5925d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1565 microversion: 2.1 time: 0.164339 Jun 24 04:20:30.697579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 297/568] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:30 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:30.713922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:30.714438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:30.720767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.721224 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.722236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:30.722718 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:30.727369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:30.800928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-87ec7a97-1523-4682-be41-2d07e8f915bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090848 Jun 24 04:20:30.801530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 298/569] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:20:30 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:31.088311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:31.088930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:31.096539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.097241 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.098250 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.098941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.342188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:31.350892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:31.352365 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:31.353550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f6db119-6639-4928-8e6c-0569c7931ddf tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.269660 Jun 24 04:20:31.354104 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 299/570] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:31 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:31.365813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:31.365813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:31.366498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.366881 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.367640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.368065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.592220 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-adf2fda7-35a8-4c66-b183-ef4e78867704 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193643 Jun 24 04:20:31.592843 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 272/571] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:20:30 2022] POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments => generated 194 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:31.598104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:31.598905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:31.605735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.606798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.607581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:31.608116 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:31.745107 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:31.753856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1b5da5b6-7578-463e-8298-60bb0904ff4c tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.398712 Jun 24 04:20:31.764969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 300/572] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:31 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:31.947882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:31.958563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02b83ecd-0849-473e-84b1-08e292ec1db4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1260 microversion: 2.1 time: 0.364159 Jun 24 04:20:31.969805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 273/573] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:31 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:32.160455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-22239b26-c8e0-49e9-af28-5c74f5281c01 req-6a12e157-9802-43ce-bcfb-654fc16e40fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:32.169578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-22239b26-c8e0-49e9-af28-5c74f5281c01 req-6a12e157-9802-43ce-bcfb-654fc16e40fc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.169578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-22239b26-c8e0-49e9-af28-5c74f5281c01 req-6a12e157-9802-43ce-bcfb-654fc16e40fc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.180410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-22239b26-c8e0-49e9-af28-5c74f5281c01 req-6a12e157-9802-43ce-bcfb-654fc16e40fc service nova] Creating event network-changed:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:20:32.186361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-22239b26-c8e0-49e9-af28-5c74f5281c01 req-6a12e157-9802-43ce-bcfb-654fc16e40fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029743 Jun 24 04:20:32.186986 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 301/574] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:32.376832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:32.377477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:32.384644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.385219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.386092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.386801 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.524588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:32.533880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:32.535416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:32.536569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8c572bba-14df-4879-b601-1376746666b1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.167768 Jun 24 04:20:32.537132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 274/575] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:32 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:32.773230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:32.773791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:32.783279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.783869 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.784747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.785281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.949132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:32.957599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eab196c1-a758-4ba3-bf95-754a905f0cf3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.189638 Jun 24 04:20:32.958177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 302/576] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:32 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:32.977009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:32.978117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:32.984664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.985115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:32.985890 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:32.986332 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.166846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:33.176284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2473a7e7-57fd-43c3-b542-de4f44c82683 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1444 microversion: 2.1 time: 0.203290 Jun 24 04:20:33.179025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 275/577] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:32 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1444 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:33.194557 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:33.195458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:33.197883 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:33.203333 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.204373 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.205156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.205593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.301423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:33.362952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:33.372397 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35c1b5fe-9ffd-4712-8598-3adfb2ad01c6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1444 microversion: 2.1 time: 0.181797 Jun 24 04:20:33.373201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 303/578] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:33 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:33.556800 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:33.557694 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:33.591950 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.592744 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.593596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.594222 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.835925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:33.846268 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:33.848802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:33.850685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-187330a4-8fc4-4752-a509-8d85ba7919fb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.298135 Jun 24 04:20:33.851755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 276/579] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:33 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:33.975687 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:33.976528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:33.992153 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.992957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:33.994259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:33.995304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:34.264465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:34.279012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8884ab8-302b-4244-b944-c4bf8c8dccc3 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.305590 Jun 24 04:20:34.279012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 304/580] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:33 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:34.896405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:34.897062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:34.905656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:34.907244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:34.908373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:34.912256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:35.098241 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:35.114883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:35.127567 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:35.130142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b136f785-757d-47ab-b1b9-0288e2dc59ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.260707 Jun 24 04:20:35.145470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 277/581] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:34 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:35.296161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:35.296899 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:35.303477 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:35.303923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:35.304926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:35.305364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:35.577275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:35.577275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6d5d3ddc-393d-494a-920d-bf641e699c9d tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.275073 Jun 24 04:20:35.577275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 305/582] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:35 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:36.153378 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:36.155313 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:36.162282 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:36.162992 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:36.163934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:36.164360 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:36.349114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:36.353533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:36.366091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:36.367911 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:36.369370 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4b3c5194-cd2b-4e00-938e-9959c4b37f5f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.220426 Jun 24 04:20:36.370204 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 278/583] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:36 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:36.456540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-e987059e-45f3-4ba0-8cf6-502b7d6adf43 req-775322e6-864f-4fd0-96f2-84d653bcb770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:36.467560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-e987059e-45f3-4ba0-8cf6-502b7d6adf43 req-775322e6-864f-4fd0-96f2-84d653bcb770 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:36.474532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-e987059e-45f3-4ba0-8cf6-502b7d6adf43 req-775322e6-864f-4fd0-96f2-84d653bcb770 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:36.485269 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-e987059e-45f3-4ba0-8cf6-502b7d6adf43 req-775322e6-864f-4fd0-96f2-84d653bcb770 service nova] Creating event network-changed:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:20:36.492549 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-e987059e-45f3-4ba0-8cf6-502b7d6adf43 req-775322e6-864f-4fd0-96f2-84d653bcb770 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039689 Jun 24 04:20:36.493242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 306/584] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:36.592513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:36.593353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:36.601976 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:36.603072 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:36.604034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:36.604523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:36.750702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:36.759084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-14b50452-bba0-4797-8353-ec1cc3cae9ea tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.171027 Jun 24 04:20:36.759762 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 279/585] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:36 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:37.331420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-6a485e2b-407d-4488-98f5-9c88671a96d0 req-80277c47-8faa-4ee8-ad83-54d49a1fa269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d33e27-a747-4178-b0e9-8b10ac11f4d2", "name": "network-vif-plugged", "status": "completed", "tag": "f515794a-f43b-43e2-8d02-230f5546e5d8"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:37.346211 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-6a485e2b-407d-4488-98f5-9c88671a96d0 req-80277c47-8faa-4ee8-ad83-54d49a1fa269 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:37.346690 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-6a485e2b-407d-4488-98f5-9c88671a96d0 req-80277c47-8faa-4ee8-ad83-54d49a1fa269 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:37.359557 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-6a485e2b-407d-4488-98f5-9c88671a96d0 req-80277c47-8faa-4ee8-ad83-54d49a1fa269 service nova] Creating event network-vif-plugged:f515794a-f43b-43e2-8d02-230f5546e5d8 for instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 on hv-cinder-84684 Jun 24 04:20:37.369920 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-6a485e2b-407d-4488-98f5-9c88671a96d0 req-80277c47-8faa-4ee8-ad83-54d49a1fa269 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043590 Jun 24 04:20:37.370906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 307/586] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:37.392757 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:37.393398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:37.400536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:37.400987 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:37.401766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:37.402196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:37.651861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:37.669133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:37.672379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:37.675266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-565cefa7-067e-4140-ba54-ea21e34d06af tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.289969 Jun 24 04:20:37.675266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 280/587] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:37 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:37.789834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:37.789834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:37.789834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:37.789834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:37.790943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:37.790943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:38.091780 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:38.168822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:38.178074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f350ca05-7d0b-408c-8d20-708504e756f2 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.405461 Jun 24 04:20:38.182224 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 308/588] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:37 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:38.693095 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:38.693791 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:38.700970 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:38.701412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:38.702182 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:38.702642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:38.856549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:38.865860 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:38.867287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:38.868429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-83e492ad-6ad3-4032-a4fa-7550bb3b6593 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.179270 Jun 24 04:20:38.868973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 281/589] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:38 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:39.195790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:39.196619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:39.204265 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:39.205158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:39.206123 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:39.206760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:39.348855 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:39.357393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c2d7bc3a-2263-4be2-82b6-61a137f015e9 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.165754 Jun 24 04:20:39.358235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 309/590] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:39 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:39.887300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:39.888076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:39.895217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:39.895660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:39.896568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:39.897004 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:40.039809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:40.048844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:40.050334 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:40.051522 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bc64d68e-9def-43b6-a9b3-4f7355fee9e3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.169098 Jun 24 04:20:40.059889 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 282/591] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:39 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:40.375359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:40.375963 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:40.382562 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:40.383010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:40.383768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:40.384209 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:40.524962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:40.533677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5b70c8d1-f46c-42ab-9204-a94b4dcff53a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.162658 Jun 24 04:20:40.534736 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 310/592] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:40 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:41.070797 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:41.071511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:41.079466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:41.079910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:41.080671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:41.081101 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:41.229026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:41.239318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:41.241207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:41.242526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-490604cf-b11b-43b8-85f6-26f415fa98ae tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.175459 Jun 24 04:20:41.254390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 283/593] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:41 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:41.551029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:41.551659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:41.558257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:41.559807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:41.560295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:41.560732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:41.697114 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:41.709588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-612e32eb-a4f5-4b2d-9fd7-3d348de6328b tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.162320 Jun 24 04:20:41.715371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 311/594] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:41 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:42.261398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:42.263097 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:42.269543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:42.269982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:42.270845 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:42.271274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:42.437575 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:42.446286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:42.447846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:42.449003 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-27c67a7d-1212-449f-a5ca-1af9235c11dd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.191693 Jun 24 04:20:42.449571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 284/595] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:42 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:42.734661 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:42.735924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:42.744025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:42.745542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:42.746661 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:42.747147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:42.892046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:42.900046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-13f95411-053c-42b0-aebc-aa4dca84b64f tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.172149 Jun 24 04:20:42.902347 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 312/596] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:42 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:43.467926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:43.468538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:43.475084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:43.475533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:43.476306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:43.476745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:43.613262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:43.622092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:43.623662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:43.624830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1ebd5b75-5298-42e6-9956-24322a40fe39 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.161432 Jun 24 04:20:43.625557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 285/597] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:43 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:43.917200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:43.918775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:43.925612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:43.926055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:43.926843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:43.927276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:44.069247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:44.077495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f13b9163-63ca-4437-b29f-3564a4afbd33 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.164468 Jun 24 04:20:44.078086 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 313/598] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:43 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:44.644207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:44.646039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:44.654341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:44.654812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:44.655566 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:44.655991 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:44.804632 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:44.813733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:44.815221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:44.820738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5d903ea4-cbb9-4660-87a4-049895191a22 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.176163 Jun 24 04:20:44.820738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 286/599] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:44 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:45.096215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:45.096829 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:45.103231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:45.106815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:45.106815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:45.106815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:45.236184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:45.243626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-14f26c09-b842-460f-bcf2-8167e21692af tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.152077 Jun 24 04:20:45.244200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 314/600] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:45 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:45.835777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:45.836433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:45.843424 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:45.843872 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:45.844630 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:45.845058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:45.974579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:45.983789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:45.985287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:45.986469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c8ec4e18-f981-4e09-9746-eb0f3ff41b84 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.154723 Jun 24 04:20:45.987015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 287/601] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:45 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:46.260522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:46.261101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:46.268060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:46.272279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:46.272279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:46.272279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:46.401907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:46.410393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a951e37c-e5cb-45d3-9bb7-50053a8b7357 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.153937 Jun 24 04:20:46.410983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 315/602] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:46 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:47.004848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:47.005449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:47.012163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.013292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.014138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.014644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.306057 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:47.315199 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:47.316695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:47.317849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8a49dd34-eb83-424f-bbc8-b09dc6455287 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.316883 Jun 24 04:20:47.318420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 288/603] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:46 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:47.427611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:47.428139 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:47.435259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.435703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.436457 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.436888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.572229 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:47.581322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f7aa49e0-a709-448b-8c6f-65b84a206016 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.157536 Jun 24 04:20:47.582130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 316/604] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:47 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:47.758967 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:47.762201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:47.765972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.766441 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.767223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:47.767653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:47.978145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:47.986170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-97174c79-a04c-46b5-8c79-b05a15165494 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1593 microversion: 2.1 time: 0.231058 Jun 24 04:20:47.986785 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 289/605] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:47 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1593 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:48.336897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:48.337535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.344790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.345241 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.346214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.346708 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.351161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:48.470105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:48.470681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.477131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.477581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.478345 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.478817 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.502925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2fbb307f-cc02-41a8-88d9-92ea66c681bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/ips" status: 200 len: 149 microversion: 2.1 time: 0.036750 Jun 24 04:20:48.503424 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 290/606] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:20:48 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:20:48.515218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937b2e71-bcbb-497d-bf6c-f42450e14f8c"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:48.516802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.523324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.523845 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.524620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.525055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.562063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:48.571545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:48.573064 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:48.574227 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-76c37150-af40-42fb-ad0b-c5aa988cb3f9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.241364 Jun 24 04:20:48.585028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 317/607] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:48 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:48.598904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:48.599627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.605812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.606949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.607902 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.608682 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.618218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: POST /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/os-volume_attachments HTTP/1.1 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 74 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:20:48.620180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {"volumeAttachment": {"volumeId": "937b2e71-bcbb-497d-bf6c-f42450e14f8c"}} Jun 24 04:20:48.622520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'server_id': 'a1608c2b-a5ad-45f3-8e24-790fd53cbe49', 'body': {'volumeAttachment': {'volumeId': '937b2e71-bcbb-497d-bf6c-f42450e14f8c'}}} Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:48.623446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:48.625525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 400 to user: Invalid volume: volume 937b2e71-bcbb-497d-bf6c-f42450e14f8c is already attached to instances: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4bab0eb2-6b83-4f4c-928e-848bda7577a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111430 Jun 24 04:20:48.627479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 291/608] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:20:48 2022] POST /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 04:20:48.631085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:48.631617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.639312 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.643147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.643147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.643147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.665959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:20:48.770349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:48.784607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-746e69d0-0879-44e2-acd3-0bcbe1b6cf61 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.189526 Jun 24 04:20:48.785187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 318/609] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:48 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:48.876392 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:48.880435 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:48.882956 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.883399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:48.884151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:48.884778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.027811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lazy-loading 'services' on Instance uuid 95960fad-f7dd-4195-97e2-b8519a0ac2d3 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:20:49.041806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-704b9e00-fcf4-42a0-a657-b2097a925f1f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 204 len: 0 microversion: 2.1 time: 0.414007 Jun 24 04:20:49.042699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 292/610] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:20:48 2022] DELETE /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:20:49.051882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:49.052778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:49.064261 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.064957 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.065919 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.066756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.217521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:49.225223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-451a94d0-bee0-47dc-90e3-452ed99959b4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1681 microversion: 2.1 time: 0.177664 Jun 24 04:20:49.225967 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 293/611] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:49 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:49.312900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-69386dca-7570-4cd5-b20f-8eb8fc1f97c7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments/26296ee5-6308-40f5-8724-9c161f945a50" status: 202 len: 0 microversion: 2.1 time: 0.441221 Jun 24 04:20:49.313412 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 319/612] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:20:48 2022] DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments/26296ee5-6308-40f5-8724-9c161f945a50 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:20:49.593948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:49.594598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:49.600893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.601342 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.602109 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.602577 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.606864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:49.743444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:49.752780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:49.754265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:49.755431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-86a4eae8-04ae-42d0-aff9-90e82ff31a21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.166266 Jun 24 04:20:49.755971 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 294/613] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:49 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:49.802213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:49.802940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:49.810500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.810946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:49.811713 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:49.812145 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.022323 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:50.031561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1a06eba1-ce8f-456c-9f70-7339cdee71ed tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.233973 Jun 24 04:20:50.032408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 320/614] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:49 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:50.188479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-3632da3b-3643-41c5-89a7-2517ef338cd8 req-96dc95a3-6f6c-47a3-9a3f-862767a6d6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:50.196925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3632da3b-3643-41c5-89a7-2517ef338cd8 req-96dc95a3-6f6c-47a3-9a3f-862767a6d6f1 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:50.197622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3632da3b-3643-41c5-89a7-2517ef338cd8 req-96dc95a3-6f6c-47a3-9a3f-862767a6d6f1 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.209417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-3632da3b-3643-41c5-89a7-2517ef338cd8 req-96dc95a3-6f6c-47a3-9a3f-862767a6d6f1 service nova] Creating event network-changed:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:20:50.214532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-3632da3b-3643-41c5-89a7-2517ef338cd8 req-96dc95a3-6f6c-47a3-9a3f-862767a6d6f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030507 Jun 24 04:20:50.215134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 295/615] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:50.244900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:50.246164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:50.252501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:50.253008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.253964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:50.254418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.407112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:50.412972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8f84fc43-4897-4973-8ae9-6e460f2992ac tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1681 microversion: 2.1 time: 0.172109 Jun 24 04:20:50.413559 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 321/616] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:50 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:50.775611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:50.778018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:50.786679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:50.787126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.787950 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:50.788381 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:50.927459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:50.938340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:50.940068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:50.941305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cbba847b-ed35-427e-b61a-c6bfc4e795db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.170867 Jun 24 04:20:50.941869 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 296/617] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:50 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:51.049784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:51.050413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:51.057336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.057848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:51.058649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.059263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:51.219518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:51.230129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2598655d-b7a2-4edb-8e9d-51a7bc0f2808 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1313 microversion: 2.1 time: 0.184660 Jun 24 04:20:51.230751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 322/618] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:51 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:51.431536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:51.432152 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:51.438159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.438669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:51.439423 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.439856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:51.588996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:51.596747 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-396c660c-e428-4c47-ba78-75232747de11 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1681 microversion: 2.1 time: 0.169656 Jun 24 04:20:51.598066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 297/619] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:51 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:51.959273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:51.959872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:51.966505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.966948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:51.967695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:51.968118 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.101458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:52.110015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:52.111592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:52.112755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fa6f92d2-3498-4351-b126-936830d29a34 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.157431 Jun 24 04:20:52.113319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 323/620] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:51 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:52.247423 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:52.248027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:52.254526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.254972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.255730 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.256159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.405257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:52.413066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-34624df6-aab9-49e7-8a3e-1fc6449d735a tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1496 microversion: 2.1 time: 0.169940 Jun 24 04:20:52.413627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 298/621] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:52 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:52.614437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:52.615036 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:52.621072 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.621544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.622595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.623074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.759063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:52.767691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bf2effa4-7fcd-4a06-9d05-8b2aa24ce9c5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1681 microversion: 2.1 time: 0.157309 Jun 24 04:20:52.768263 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 324/622] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:52 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:52.769561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1655786945"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:52.770128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:52.772294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:52.777325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.777940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.779240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:52.779676 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:52.916754 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.network.security_group_api [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Adding security group 3126237a-d470-4df6-b2d3-1f030e73085d to port 119eca9e-1070-4304-801e-2d66cb712073 Jun 24 04:20:53.131735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:53.134581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:53.139169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.139610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.140442 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.140872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.274698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:53.284014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:53.285494 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:53.287306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-66482237-63b0-408d-97b0-1b684728b8e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.159599 Jun 24 04:20:53.287884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 325/623] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:53 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:53.357482 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:53.358047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:53.364197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.364704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.365560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.366053 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.391259 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:20:53.726793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e3563b68-4ee4-43bf-8e22-d708bd3b4a37 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "DELETE /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 204 len: 0 microversion: 2.1 time: 0.373096 Jun 24 04:20:53.727575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 326/624] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:20:53 2022] DELETE /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:20:53.741696 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:53.742415 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:53.749236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.749729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.750542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.750977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.807775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-eae614e7-889e-4bb8-9d2c-21de0c575e41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action" status: 202 len: 0 microversion: 2.1 time: 1.042485 Jun 24 04:20:53.809560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 299/625] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:20:52 2022] POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:20:53.814450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:53.815254 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:53.822067 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.822840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.823812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:53.824393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:53.960460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:53.978822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-64888206-184d-41aa-b31e-98eb90602986 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1502 microversion: 2.1 time: 0.242545 Jun 24 04:20:53.983135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 327/626] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:53 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:53.988967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-8bdb8767-7f6f-40a2-90da-4646b44594cf req-ed5680e2-003c-43e4-9e5d-fa54b5143af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:53.999908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8bdb8767-7f6f-40a2-90da-4646b44594cf req-ed5680e2-003c-43e4-9e5d-fa54b5143af9 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:54.002590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8bdb8767-7f6f-40a2-90da-4646b44594cf req-ed5680e2-003c-43e4-9e5d-fa54b5143af9 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:54.017593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-8bdb8767-7f6f-40a2-90da-4646b44594cf req-ed5680e2-003c-43e4-9e5d-fa54b5143af9 service nova] Creating event network-changed:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:20:54.026284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-8bdb8767-7f6f-40a2-90da-4646b44594cf req-ed5680e2-003c-43e4-9e5d-fa54b5143af9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041720 Jun 24 04:20:54.029470 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 328/627] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:54.042479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:54.042882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:54.044882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:54.066891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-94a815c8-0e56-4d7c-8193-6a36ed443a65 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1681 microversion: 2.1 time: 0.241379 Jun 24 04:20:54.066891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 300/628] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:53 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:54.067078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:54.067078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:54.067078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:54.067078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:54.242772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:54.252318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f7005e4c-61a0-43af-885a-d9537faa8fd4 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1640 microversion: 2.1 time: 0.221608 Jun 24 04:20:54.252940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 329/629] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:54 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1640 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:54.310926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:54.311520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:54.318464 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:54.319041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:54.320020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:54.320449 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:54.514437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:54.528520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:54.530525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:54.531810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e1bc9b1d-c056-449e-9261-e0608ed10820 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.226590 Jun 24 04:20:54.532434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 301/630] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:54 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:54.997961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:54.998737 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:55.005720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.006285 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.007147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.007648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.076911 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:55.077756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:55.086075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.086641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.087709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.088284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.167242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:55.172843 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:55.181031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b84ae9ed-361e-4634-be86-f01bff79da65 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1502 microversion: 2.1 time: 0.187346 Jun 24 04:20:55.181715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 330/631] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:54 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:55.186031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-049b05e1-256d-4878-838b-7df171c011fb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1613 microversion: 2.1 time: 0.113442 Jun 24 04:20:55.197170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 302/632] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:55 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:55.550031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:55.550720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:55.556668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.557117 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.557884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:55.558322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:55.954939 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:55.963448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:55.964946 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:55.967854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-622091f1-88c4-4a6c-9140-55602806f239 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.421803 Jun 24 04:20:55.968759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 331/633] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:55 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:56.051671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-87d46918-df53-490b-a030-a84639c50b3b req-51057b8c-05ee-439c-af84-5f82d2dce9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1608c2b-a5ad-45f3-8e24-790fd53cbe49", "name": "network-vif-deleted", "tag": "337acde5-acd2-490f-b729-39d3e95ad6d4"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:56.066006 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-87d46918-df53-490b-a030-a84639c50b3b req-51057b8c-05ee-439c-af84-5f82d2dce9b3 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.066006 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-87d46918-df53-490b-a030-a84639c50b3b req-51057b8c-05ee-439c-af84-5f82d2dce9b3 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.078930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-87d46918-df53-490b-a030-a84639c50b3b req-51057b8c-05ee-439c-af84-5f82d2dce9b3 service nova] Creating event network-vif-deleted:337acde5-acd2-490f-b729-39d3e95ad6d4 for instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 on hv-cinder-84684 Jun 24 04:20:56.084555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-87d46918-df53-490b-a030-a84639c50b3b req-51057b8c-05ee-439c-af84-5f82d2dce9b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046515 Jun 24 04:20:56.085261 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 303/634] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:56.201863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:56.202929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:56.204380 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:56.205073 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:56.211807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.212534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.213659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.214300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.220685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.223690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.223690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.223690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.244199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:56.385980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:56.396901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:56.400594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-915bdd7a-f93a-41b5-bc9a-e7e024324cdb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1613 microversion: 2.1 time: 0.200980 Jun 24 04:20:56.401776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 304/635] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:56 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1613 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:56.409762 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-266e4c96-c426-47bc-ac8f-e4ecf2f01d5e tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1502 microversion: 2.1 time: 0.214099 Jun 24 04:20:56.424759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 332/636] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:56 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:56.819963 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1a3a3fac-0746-4d44-9e70-d5a7d71a194f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:56.827526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a3a3fac-0746-4d44-9e70-d5a7d71a194f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.828207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1a3a3fac-0746-4d44-9e70-d5a7d71a194f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.851429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1a3a3fac-0746-4d44-9e70-d5a7d71a194f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Going to try to stop instance {{(pid=118330) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 04:20:56.985605 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:56.986246 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:56.993514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.993879 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:56.994681 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:56.995110 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.063581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1a3a3fac-0746-4d44-9e70-d5a7d71a194f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action" status: 202 len: 0 microversion: 2.1 time: 0.247317 Jun 24 04:20:57.064184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 305/637] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:20:56 2022] POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:20:57.072962 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:57.073674 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:57.080169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.080806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.081491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.081931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.190686 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.200303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.202217 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.203569 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2573f65d-5198-4d02-92c5-48ceef371d44 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.221873 Jun 24 04:20:57.205502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 333/638] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:56 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:20:57.284646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.292361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-63ad82cd-d046-477a-a740-11c43db6dae6 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.223593 Jun 24 04:20:57.292929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 306/639] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:57 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:57.420246 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:57.427053 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:57.428232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.428689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.429464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.429870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.432334 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:57.433012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:57.439851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.440309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.441078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.441507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.471001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.471736 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.472489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'fault' on Instance uuid a1608c2b-a5ad-45f3-8e24-790fd53cbe49 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:20:57.521896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.532199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c39d2ab1-3e48-48f1-bffd-5adc1ac78352 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 200 len: 1331 microversion: 2.1 time: 0.116780 Jun 24 04:20:57.533025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 334/640] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:57 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:57.552861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:57.561398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e61f4803-ea2d-4763-9a11-d4629a15c1f8 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1298 microversion: 2.1 time: 0.132882 Jun 24 04:20:57.561977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 307/641] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:57 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:57.677767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-265dc593-b002-4b0b-af1f-bb85fb455308 req-29b22130-2775-4f78-9fd1-cac750fe7a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "name": "network-vif-plugged", "status": "completed", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:57.688151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-265dc593-b002-4b0b-af1f-bb85fb455308 req-29b22130-2775-4f78-9fd1-cac750fe7a2f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:57.688784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-265dc593-b002-4b0b-af1f-bb85fb455308 req-29b22130-2775-4f78-9fd1-cac750fe7a2f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:57.701759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-265dc593-b002-4b0b-af1f-bb85fb455308 req-29b22130-2775-4f78-9fd1-cac750fe7a2f service nova] Creating event network-vif-plugged:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:20:57.707384 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-265dc593-b002-4b0b-af1f-bb85fb455308 req-29b22130-2775-4f78-9fd1-cac750fe7a2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Jun 24 04:20:57.708546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 335/642] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:58.100042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-24a44a44-fec9-4e08-9e87-4d5cb6fdb063 req-f788c728-1747-4c82-b2b4-3666efd0d9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d33e27-a747-4178-b0e9-8b10ac11f4d2", "name": "network-vif-deleted", "tag": "f515794a-f43b-43e2-8d02-230f5546e5d8"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:20:58.109729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-24a44a44-fec9-4e08-9e87-4d5cb6fdb063 req-f788c728-1747-4c82-b2b4-3666efd0d9a5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.110162 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-24a44a44-fec9-4e08-9e87-4d5cb6fdb063 req-f788c728-1747-4c82-b2b4-3666efd0d9a5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.120796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-24a44a44-fec9-4e08-9e87-4d5cb6fdb063 req-f788c728-1747-4c82-b2b4-3666efd0d9a5 service nova] Creating event network-vif-deleted:f515794a-f43b-43e2-8d02-230f5546e5d8 for instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 on hv-cinder-84684 Jun 24 04:20:58.126105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-24a44a44-fec9-4e08-9e87-4d5cb6fdb063 req-f788c728-1747-4c82-b2b4-3666efd0d9a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Jun 24 04:20:58.126695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 308/643] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:20:58.224094 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:58.232754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:58.232754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.232754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.232754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.233166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.310085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:58.310898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:58.317382 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.317833 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.318621 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.319046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.367769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:58.377031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:58.378532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:58.379708 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d7c92fa0-a695-4661-a9f2-b583d870aa1a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.160211 Jun 24 04:20:58.380268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 336/644] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:58 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:58.472554 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:58.480232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cbf049c0-0caa-4e4e-a5ab-4e6dd31d2174 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.174803 Jun 24 04:20:58.481563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 309/645] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:58 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:58.550422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:58.551325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:58.559637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.560017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.560795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.561231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.576529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 HTTP/1.1 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:20:58.578181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:20:58.579666 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'a1608c2b-a5ad-45f3-8e24-790fd53cbe49'} Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:20:58.580462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:20:58.581679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:58.583796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:20:58.583875 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:58.584235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0801128f-3867-461d-bca6-831b58ff3500 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 404 len: 111 microversion: 2.1 time: 0.034067 Jun 24 04:20:58.584337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:58.584434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 337/646] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:58 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:20:58.587272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.587787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.588664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.589176 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8145a00b-f2e4-42b0-ad1e-7ba0cd71b096 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '.version_select at 0x7fdfed538dc0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:58.589320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.622893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:58.623337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:58.623780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lazy-loading 'fault' on Instance uuid 20d33e27-a747-4178-b0e9-8b10ac11f4d2 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:20:58.669736 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6ef9f5f6ac4b6289aa1aa9e16ce4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46222aa2184c4a6d82b65d3c703c8bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:58.677340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0b5382bc-2c7b-4c5d-b4c3-e558d8770123 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 200 len: 1303 microversion: 2.1 time: 0.102417 Jun 24 04:20:58.678070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 310/647] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:58 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:20:58.705607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8145a00b-f2e4-42b0-ad1e-7ba0cd71b096 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-414504536" status: 202 len: 0 microversion: 2.1 time: 0.120262 Jun 24 04:20:58.706284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 338/648] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jun 24 04:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-414504536 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:20:59.399745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:59.400348 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:59.407670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.408113 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.409189 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.409623 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.498658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:59.499463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:59.506398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.506840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.507597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.508027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.599012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:59.603042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:20:59.610318 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:59.612030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:59.613263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4e8aa471-c5d4-45a3-bac3-a84714da233b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.219262 Jun 24 04:20:59.613808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 311/649] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:20:59 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:20:59.623609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:59.624390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:59.630453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.630906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.631666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.632097 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.650611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:20:59.658747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5f497675-ac42-4604-94a2-87a6faddd357 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.164505 Jun 24 04:20:59.659406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 339/650] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:59 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:20:59.696725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:20:59.697325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] [instance: 20d33e27-a747-4178-b0e9-8b10ac11f4d2] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:20:59.705165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.707150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.707150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:20:59.707150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:20:59.721874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] HTTP exception thrown: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Request method failure captured: Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 HTTP/1.1 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTtX5vvV26zetHM7LLnpDyF98CPt9XRGfpcg2PJO2KqeGxv2s-lM5BYQ_9811XkH_HayBjdwoElAw-Fn4EfMz_DpGgCdy8vpPEhGbjXRgfNtISDvWFi-GeGdjow6RYeVMgTUyFdAAtp2ms543xrrhMzptBrptPaCgAJbs_y9_xoMZwg Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 46222aa2184c4a6d82b65d3c703c8bd7 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:20:59.723638 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46222aa2184c4a6d82b65d3c703c8bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46222aa2184c4a6d82b65d3c703c8bd7"}]}] Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 46222aa2184c4a6d82b65d3c703c8bd7 Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesActionsTest-2055076363 Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesActionsTest-2055076363-project Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 8c6ef9f5f6ac4b6289aa1aa9e16ce4bb Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesActionsTest-2055076363-project Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. Jun 24 04:20:59.725137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '20d33e27-a747-4178-b0e9-8b10ac11f4d2'} Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:20:59.728030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. Jun 24 04:20:59.729399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:20:59.732052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] Returning 404 to user: Instance 20d33e27-a747-4178-b0e9-8b10ac11f4d2 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:20:59.732052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-20905908-b71a-40ab-9ca5-39a07c78ef58 tempest-VolumesActionsTest-2055076363 tempest-VolumesActionsTest-2055076363-project] 10.222.0.16 "GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2" status: 404 len: 111 microversion: 2.1 time: 0.033551 Jun 24 04:20:59.732052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 340/651] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:20:59 2022] GET /compute/v2.1/servers/20d33e27-a747-4178-b0e9-8b10ac11f4d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 04:20:59.768809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'services' on Instance uuid f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:21:00.029356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cf131906-84b1-47fe-9b80-4368059cabd5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments/937b2e71-bcbb-497d-bf6c-f42450e14f8c" status: 202 len: 0 microversion: 2.1 time: 0.409996 Jun 24 04:21:00.029954 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 312/652] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:20:59 2022] DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments/937b2e71-bcbb-497d-bf6c-f42450e14f8c => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:21:00.038810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:00.040062 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:00.047147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.047597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.048367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.048966 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.090870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cfef1ad0-754d-4e16-bd6a-99a5ad90566b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055652 Jun 24 04:21:00.091527 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 341/653] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:00 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:00.633473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:00.634362 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:00.641353 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.641829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.642617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.643043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.676566 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:00.677161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:00.684977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.685423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.686192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:00.686649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:00.780992 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:00.789841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:00.791360 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:00.803414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-70d967ee-7e61-4214-9ca3-2e7caea12de6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.174547 Jun 24 04:21:00.804506 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 313/654] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:00 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:00.833223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:00.841240 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c258553c-e8c5-49f1-a589-20a6aa7e5c9a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.168568 Jun 24 04:21:00.841805 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 342/655] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:00 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:01.102670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:01.103609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:01.114281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.114281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.114281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.114281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.147145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c9966a3d-6397-4ef8-95f7-79363a86f6ae tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Jun 24 04:21:01.148240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 314/656] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:01 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:01.822625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:01.829495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:01.830800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.831268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.832018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.832467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.858719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:01.859345 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:01.865806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.866249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.867046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:01.867481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:01.963845 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:01.973276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:01.975825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:01.976975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d4b08dd8-b684-47c1-af5b-608971112e79 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.158727 Jun 24 04:21:01.983587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 343/657] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:01 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:02.005853 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:02.014090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-96676b2e-05ab-41df-86d8-74e48deb1468 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.159556 Jun 24 04:21:02.014687 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 315/658] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:01 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:02.159112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:02.160088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:02.166256 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:02.166752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:02.167545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:02.168518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:02.198260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-79576f1d-40b8-4c3f-ad72-d53de2cf9e33 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Jun 24 04:21:02.198869 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 344/659] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:02 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:02.995721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:02.996429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:03.004287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.004733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.005497 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.005931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.031712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:03.032458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:03.045265 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.045715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.046514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.046948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.139022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:03.147653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:03.149416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:03.150607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d89b50b2-1ec0-4d7d-a267-3ce4c2bca7bb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.159124 Jun 24 04:21:03.151158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 316/660] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:02 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:03.185018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:03.192707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b0e41251-3ee9-49b5-b4a8-996812a2b37f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.164716 Jun 24 04:21:03.193266 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 345/661] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:03 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:03.209142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:03.210112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:03.216772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.217219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.217970 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:03.218419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:03.246764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ea3db6ba-b846-48b5-8ca3-72b2364f3a5e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Jun 24 04:21:03.247235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 317/662] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:03 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:04.168697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:04.169296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:04.171853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:04.176563 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.177023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.183175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.183175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.210040 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:04.210767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:04.217545 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.223329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.223329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.223329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.318817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:04.329793 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:04.332572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:04.334019 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-706f4b6b-d2bf-4c3e-b958-5a95ec3e683e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1808 microversion: 2.20 time: 0.169271 Jun 24 04:21:04.334796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 346/663] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:04 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:04.340433 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:04.341357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:04.347724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.348172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.348952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:04.349387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:04.358602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:04.366177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3c428bc2-3df2-4e6a-9d8a-132374773602 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.160137 Jun 24 04:21:04.366778 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 318/664] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:04 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:04.385059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9f0cf8b7-ba33-41a9-a3b5-f4c1b22a4894 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048761 Jun 24 04:21:04.385916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 347/665] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:04 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:05.353721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:05.354290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:05.360760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.361198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.361943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.364879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.385032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:05.385630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:05.392599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.393040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.393795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.394219 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.493365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:05.502854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:05.504673 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:05.506086 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d1d55c67-a3d6-4c48-947b-577ba9599913 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1795 microversion: 2.20 time: 0.156315 Jun 24 04:21:05.518670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 319/666] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:05 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:05.526560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:05.527723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:05.527933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:05.534900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.535552 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.536322 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.536907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.538023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-95e8856e-2a00-4659-869e-e046552ce2ee tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.156681 Jun 24 04:21:05.538957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 348/667] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:05 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:05.566955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6f2b5fc0-e0e7-43fe-a601-ea845b8cef92 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058570 Jun 24 04:21:05.567513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 320/668] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:21:05 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:21:05.625753 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:05.627613 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:05.632871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.633311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.634100 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:05.634552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:05.663847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:21:05.769533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:06.024303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e73b983-2ca8-4e04-a2f2-c119c1d3b3ec tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 204 len: 0 microversion: 2.1 time: 0.402761 Jun 24 04:21:06.025270 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 349/669] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:21:05 2022] DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:21:06.034286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:06.035359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:06.047622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:06.047622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:06.048158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:06.050193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:06.241757 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:06.250683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b21b9309-b17f-4048-81e8-e6b802124e99 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1679 microversion: 2.1 time: 0.219907 Jun 24 04:21:06.254423 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 321/670] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:06 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:06.558079 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:06.560135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:06.568580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:06.569457 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:06.570521 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:06.571177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:06.760705 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:06.769353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7b9cb69c-9af0-413f-90ff-d495d2d00584 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.216816 Jun 24 04:21:06.770198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 350/671] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:06 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:07.273634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:07.274440 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:07.283219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:07.283840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:07.284610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:07.285046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:07.444389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:07.453007 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9cc5f124-579b-4089-8d9e-fe6503f76ef5 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1679 microversion: 2.1 time: 0.183652 Jun 24 04:21:07.453966 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 322/672] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:07 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:07.787706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:07.788439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:07.796676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:07.797069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:07.797846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:07.798272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:07.940656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:07.950868 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06dc95da-c363-49a1-9bae-9add41996dda tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.166952 Jun 24 04:21:07.952362 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 351/673] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:07 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:08.471642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:08.472434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:08.482321 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:08.482904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:08.483810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:08.484511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:08.755643 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:08.760401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ed53d2d3-dd5f-4ed4-b0ca-b1887d2d83c8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1679 microversion: 2.1 time: 0.293229 Jun 24 04:21:08.761052 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 323/674] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:08 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1679 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:08.974302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:08.975637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:08.982512 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:08.983492 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:08.984437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:08.985015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:09.151499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:09.160852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b716cc9d-04cd-4ee6-a40f-f0b8c5ff9c20 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.191020 Jun 24 04:21:09.162023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 352/675] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:08 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:09.471106 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-b8a9ffbc-d6aa-48e5-bd1d-75cc37517dfb req-ce7d2d40-0b6b-4293-856b-10d4a7f8c7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570", "name": "network-vif-deleted", "tag": "9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:09.492246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b8a9ffbc-d6aa-48e5-bd1d-75cc37517dfb req-ce7d2d40-0b6b-4293-856b-10d4a7f8c7b0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:09.492917 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b8a9ffbc-d6aa-48e5-bd1d-75cc37517dfb req-ce7d2d40-0b6b-4293-856b-10d4a7f8c7b0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:09.515030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-b8a9ffbc-d6aa-48e5-bd1d-75cc37517dfb req-ce7d2d40-0b6b-4293-856b-10d4a7f8c7b0 service nova] Creating event network-vif-deleted:9c528a6e-2ee8-42a8-8f43-0b0ec5988a9a for instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 on hv-cinder-84684 Jun 24 04:21:09.521855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-b8a9ffbc-d6aa-48e5-bd1d-75cc37517dfb req-ce7d2d40-0b6b-4293-856b-10d4a7f8c7b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054367 Jun 24 04:21:09.523392 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 324/676] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:09.781269 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:09.782355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:09.789811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:09.790342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:09.791369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:09.791991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:09.836654 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:09.837541 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:09.838215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'fault' on Instance uuid f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:21:09.893578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:09.907519 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f919b213-a573-4cc4-b65b-7c7ca8910437 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 200 len: 1330 microversion: 2.1 time: 0.133708 Jun 24 04:21:09.908096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 353/677] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:09 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:10.181742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:10.182937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:10.191129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:10.192018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:10.193185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:10.193698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:10.419620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:10.431023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-db0ad690-7940-4925-a6db-4589cf28890e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.254511 Jun 24 04:21:10.447789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 325/678] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:10 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:10.930351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:10.931698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:10.941517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:10.941840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:10.942730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:10.943161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:10.962222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 HTTP/1.1 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:21:10.964308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:21:10.966533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570'} Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:21:10.967357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:21:10.968599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:10.969937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:21:10.969937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d29165a9-2c04-44b1-ab10-30f3a56591ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 404 len: 111 microversion: 2.1 time: 0.039461 Jun 24 04:21:10.969937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 354/679] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:10 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:21:10.974946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5564af39-bbdc-41d1-8dde-bec8f0531b7b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '.version_select at 0x7fdfed2efd30>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:11.060490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5564af39-bbdc-41d1-8dde-bec8f0531b7b tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133900604" status: 202 len: 0 microversion: 2.1 time: 0.089436 Jun 24 04:21:11.061074 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 326/680] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jun 24 04:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133900604 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:21:11.452011 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:11.452659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:11.470097 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:11.470593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:11.471363 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:11.471801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:11.625766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:11.633746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e60cb0f7-c455-47df-8df0-9185677a2b7c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.186447 Jun 24 04:21:11.644328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 355/681] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:11 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:11.927727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-02bcc28f-797d-4449-b301-a4121e37719a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: .version_select at 0x7fdfed2f4b80>, body: {"keypair": {"name": "tempest-keypair-481669819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfN1lvr3lHU8Xdh77JxgIl+xv8P4ZYxWJc1JX1MB/kuiY/h8FO6U7NeyO5LLMRPqkr+BCSPt0kCSLt8/024gvDud3Lxq3QBALfqA5wdoFba4P1f5t47JhZxLXmuuhW+BA=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:11.942210 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-02bcc28f-797d-4449-b301-a4121e37719a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:21:11.946102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-02bcc28f-797d-4449-b301-a4121e37719a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:21:12.128034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-02bcc28f-797d-4449-b301-a4121e37719a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203878 Jun 24 04:21:12.128852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 327/682] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:21:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:21:12.652390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:12.656205 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:12.664580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:12.665307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:12.666475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:12.667093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:12.844158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:12.853388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b96af7df-e2cf-4c56-a595-32edb5219d98 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1676 microversion: 2.1 time: 0.206462 Jun 24 04:21:12.854270 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 356/683] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:12 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:13.871953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:13.873664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:13.881679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:13.882154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:13.883170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:13.883944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:14.121929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:14.130680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e08f903f-8317-4115-a547-60c693c0a470 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1653 microversion: 2.1 time: 0.262911 Jun 24 04:21:14.143909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 328/684] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:13 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1653 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:14.148544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2dc7697d-48ca-45b3-b495-f2d3e2db5c72 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:14.159089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2dc7697d-48ca-45b3-b495-f2d3e2db5c72 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:14.159832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2dc7697d-48ca-45b3-b495-f2d3e2db5c72 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:14.190160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2dc7697d-48ca-45b3-b495-f2d3e2db5c72 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Going to try to start instance {{(pid=118331) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 04:21:14.384582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2dc7697d-48ca-45b3-b495-f2d3e2db5c72 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action" status: 202 len: 0 microversion: 2.1 time: 0.239796 Jun 24 04:21:14.390023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 357/685] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:21:14 2022] POST /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:21:14.398538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:14.399741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:14.416890 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:14.419977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:14.422241 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:14.426246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:14.655609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:14.665493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ac558cfe-a506-4d8e-894e-2901d76bcd99 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1662 microversion: 2.1 time: 0.272563 Jun 24 04:21:14.666836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 329/686] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:14 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1662 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:15.146889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024914106", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7"}], "security_groups": [{"name": "tempest-securitygroup--1129229853"}], "key_name": "tempest-keypair-481669819", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:15.272348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] validate_networks() for [('a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:21:15.685935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:15.687243 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:15.703826 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:15.704345 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:15.705066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:15.705529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:15.734359 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:21:15.741081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:21:15.741081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:21:15.741357 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:15.741460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:21:15.741460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:21:15.747610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:15.748065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:15.748869 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:15.749304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:15.768879 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:21:15.773611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:21:15.788226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:21:15.790982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:21:15.891698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:15.902071 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3090692a-74f6-4e14-b89f-1ca61605b2dc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1662 microversion: 2.1 time: 0.221544 Jun 24 04:21:15.917939 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 330/687] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:15 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1662 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:15.947705 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ee65f92f-7666-4e14-8f79-1ce7ebc0be85 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.807225 Jun 24 04:21:15.948958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 358/688] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:21:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:21:15.963321 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0abdb9ee-f6d5-414a-83da-160ea0ec2ad1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:15.964294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0abdb9ee-f6d5-414a-83da-160ea0ec2ad1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:16.072991 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0abdb9ee-f6d5-414a-83da-160ea0ec2ad1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:16.081231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0abdb9ee-f6d5-414a-83da-160ea0ec2ad1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1241 microversion: 2.1 time: 0.125212 Jun 24 04:21:16.083792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 331/689] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:15 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:16.922778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:16.924526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:16.932422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:16.932993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:16.934148 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:16.934735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:17.085596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:17.114538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:17.116543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:17.123869 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b4deb371-bfef-4e07-921f-0cfaf694e2e4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1666 microversion: 2.1 time: 0.205663 Jun 24 04:21:17.124468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 359/690] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:16 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:17.125881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:17.126603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:17.127668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:17.128343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:17.226961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:17.239055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8a111fb2-1d92-4987-b40a-2011df45047e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1245 microversion: 2.1 time: 0.127809 Jun 24 04:21:17.245416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 332/691] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:17 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:18.257824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:18.259108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:18.267124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:18.268012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:18.268782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:18.269401 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:18.362405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:18.372039 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8fa91108-a714-43eb-8044-39aeba3b6bce tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1301 microversion: 2.1 time: 0.118626 Jun 24 04:21:18.373731 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 360/692] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:18 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:19.392645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:19.397584 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:19.406305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:19.406854 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:19.408002 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:19.408670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:19.675772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:19.689599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5bdfd179-cf0f-4c52-a9a5-418c2b79006c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.302766 Jun 24 04:21:19.690894 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 333/693] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:19 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:20.674328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-5df9e79f-a370-44e0-8439-6f2e0a8ead39 req-be160279-2cfa-45f0-8f33-30ab0253d9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ac8aeb-d87b-48df-9a78-d17d9a2967a3", "tag": "54b8f8a3-1d8e-4be9-9c0c-2bb12134879a"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:20.688349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-5df9e79f-a370-44e0-8439-6f2e0a8ead39 req-be160279-2cfa-45f0-8f33-30ab0253d9c0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:20.689142 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-5df9e79f-a370-44e0-8439-6f2e0a8ead39 req-be160279-2cfa-45f0-8f33-30ab0253d9c0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:20.705391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-5df9e79f-a370-44e0-8439-6f2e0a8ead39 req-be160279-2cfa-45f0-8f33-30ab0253d9c0 service nova] Creating event network-changed:54b8f8a3-1d8e-4be9-9c0c-2bb12134879a for instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 on hv-cinder-84684 Jun 24 04:21:20.714022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-5df9e79f-a370-44e0-8439-6f2e0a8ead39 req-be160279-2cfa-45f0-8f33-30ab0253d9c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044807 Jun 24 04:21:20.718502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 361/694] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:20.730511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:20.734177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:20.746298 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:20.746800 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:20.749007 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:20.749457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:21.039002 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:21.046792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-19faf503-213a-488c-998a-c74269a3ac8d tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.333045 Jun 24 04:21:21.047362 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 334/695] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:20 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:22.064561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:22.069353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:22.071529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:22.071968 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:22.072724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:22.073157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:22.205081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:22.212524 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5f6be81c-fe81-41a1-889d-d5a17d3b3bff tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.152623 Jun 24 04:21:22.216727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 362/696] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:22 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:23.230020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:23.230669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:23.233656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:23.238686 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:23.239132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:23.239894 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:23.240347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:23.375087 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:23.382641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0d2ab03c-062c-40c4-8d18-2da1bc827670 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.156432 Jun 24 04:21:23.383195 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 335/697] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:23 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:24.399879 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:24.400683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:24.407366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:24.407816 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:24.408573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:24.409008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:24.545520 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:24.555614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3fabb62f-a704-4025-bb49-2eee4bb919e2 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.157330 Jun 24 04:21:24.555614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 363/698] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:24 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:25.571529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:25.572141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:25.579492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:25.579946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:25.580748 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:25.581187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:25.853150 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:25.854959 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-98471155-7c45-4c47-bacc-42a9da3a3757 req-b21b8d4a-0227-4c77-bb0f-30e5ce3a52cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ac8aeb-d87b-48df-9a78-d17d9a2967a3", "name": "network-vif-plugged", "status": "completed", "tag": "54b8f8a3-1d8e-4be9-9c0c-2bb12134879a"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:25.875025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:25.875025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:25.875332 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6efdeb50-bd02-4377-8383-95c9cd66ecf1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.296909 Jun 24 04:21:25.875422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-98471155-7c45-4c47-bacc-42a9da3a3757 req-b21b8d4a-0227-4c77-bb0f-30e5ce3a52cf service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:25.875422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-98471155-7c45-4c47-bacc-42a9da3a3757 req-b21b8d4a-0227-4c77-bb0f-30e5ce3a52cf service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:25.879288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 336/699] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:25 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:25.892313 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-98471155-7c45-4c47-bacc-42a9da3a3757 req-b21b8d4a-0227-4c77-bb0f-30e5ce3a52cf service nova] Creating event network-vif-plugged:54b8f8a3-1d8e-4be9-9c0c-2bb12134879a for instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 on hv-cinder-84684 Jun 24 04:21:25.897604 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-98471155-7c45-4c47-bacc-42a9da3a3757 req-b21b8d4a-0227-4c77-bb0f-30e5ce3a52cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046012 Jun 24 04:21:25.899291 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 364/700] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:21:26.884288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:26.884965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:26.887314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=6 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:26.893720 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:26.894178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:26.895010 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:26.895553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:26.975133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:26.976084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:26.983785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:26.984224 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:26.984994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:26.985424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:27.033375 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:27.053308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-17950db4-f680-4281-8595-4468dfd9eff9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.173569 Jun 24 04:21:27.054030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 337/701] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:26 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:27.226873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-80617a17-0485-4405-9103-a17bbcd3c050 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action" status: 202 len: 0 microversion: 2.1 time: 0.256050 Jun 24 04:21:27.227858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 365/702] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:21:26 2022] POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:21:27.236678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:27.237279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:27.243520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:27.243958 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:27.244718 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:27.245150 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:27.387927 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:27.396634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f8d604c7-0797-4e70-99c3-e300f57d6411 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1751 microversion: 2.1 time: 0.164681 Jun 24 04:21:27.397193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 338/703] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:27 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:28.071095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:28.071709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:28.078759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.079216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.079982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.080418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.173457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b07ed1-c129-49a2-9dc4-dc19afed1898"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:28.177369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:28.181711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.182153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.182953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.183378 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.225450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:28.229433 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:28.234712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-55c568c9-33ca-4164-999f-79c50cb2c59f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1367 microversion: 2.1 time: 0.168300 Jun 24 04:21:28.235293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 366/704] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:28 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:28.414815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:28.415508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:28.422791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.423240 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.424202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:28.424635 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:28.571066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:28.579649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f25e6668-c985-4611-abb0-474800a1c687 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1751 microversion: 2.1 time: 0.168838 Jun 24 04:21:28.580155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 367/705] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:28 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:29.251206 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:29.251964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:29.258725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.264882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.264882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.264882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.339254 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7ec0cb8f-c158-4155-8cb8-416fbc36fc07 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171402 Jun 24 04:21:29.339858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 339/706] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:21:28 2022] POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments => generated 194 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:21:29.397706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:29.405641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d76ea820-0905-46ce-957b-2286a368d7bb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1557 microversion: 2.1 time: 0.158646 Jun 24 04:21:29.406202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 368/707] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:29 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:29.423973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:29.423973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:29.429550 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.429996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.430779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.431214 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.511933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d71a55a8-5aa5-4c82-8529-6f867fbdc90c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093735 Jun 24 04:21:29.512525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 340/708] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:21:29 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:29.597153 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:29.597814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:29.603943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.608052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.608052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:29.608052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:29.752853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:29.761679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-42e2641a-116c-4887-bfaa-6734e8e32aae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.168712 Jun 24 04:21:29.765697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 369/709] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:29 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:30.528268 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-b51793a0-cde6-44c7-9f58-aae8e417a70a req-fef510a8-bba1-489f-ac7c-bc49086a0047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ac8aeb-d87b-48df-9a78-d17d9a2967a3", "tag": "54b8f8a3-1d8e-4be9-9c0c-2bb12134879a"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:30.537178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b51793a0-cde6-44c7-9f58-aae8e417a70a req-fef510a8-bba1-489f-ac7c-bc49086a0047 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:30.537616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-b51793a0-cde6-44c7-9f58-aae8e417a70a req-fef510a8-bba1-489f-ac7c-bc49086a0047 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:30.552185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-b51793a0-cde6-44c7-9f58-aae8e417a70a req-fef510a8-bba1-489f-ac7c-bc49086a0047 service nova] Creating event network-changed:54b8f8a3-1d8e-4be9-9c0c-2bb12134879a for instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 on hv-cinder-84684 Jun 24 04:21:30.557293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-b51793a0-cde6-44c7-9f58-aae8e417a70a req-fef510a8-bba1-489f-ac7c-bc49086a0047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Jun 24 04:21:30.558269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 341/710] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:30.783128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:30.784684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:30.797650 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:30.798222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:30.800984 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:30.801538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:30.958136 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:30.966741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2cbf2430-c87e-4943-8bcd-8a7359fda7c6 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.190159 Jun 24 04:21:30.970432 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 370/711] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:30 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:31.985660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:31.986494 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:31.993708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:31.993708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:31.994444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:31.994880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:32.143665 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:32.151905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d3969aa3-96b7-468f-b474-f120d523adea tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.171240 Jun 24 04:21:32.156662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 342/712] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:31 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:33.170743 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:33.171463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:33.178049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:33.178554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:33.179303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:33.179726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:33.319938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:33.328426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cbe18534-e368-4b4b-9635-f68ddd5d35b7 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.162138 Jun 24 04:21:33.328993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 371/713] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:33 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:34.345193 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:34.346012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:34.353945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:34.353945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:34.354466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:34.354972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:34.512146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:34.520641 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-036afc61-470d-42f2-89f3-923197889f41 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.179545 Jun 24 04:21:34.521192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 343/714] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:34 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:35.541999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:35.543084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:35.547166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:35.554754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:35.555838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:35.557089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:35.557799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:35.723512 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:35.733915 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d8e47204-1064-4cd6-b50f-7bc1def37474 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.197981 Jun 24 04:21:35.734904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 372/715] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:35 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:36.750692 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:36.751297 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:36.757733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:36.758173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:36.758959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:36.759385 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:36.913879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:36.924049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2d85004c-0610-437e-942c-453515dbb0e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.177042 Jun 24 04:21:36.924630 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 344/716] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:36 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:37.941379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:37.941979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:37.942416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:37.942518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:37.949101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:37.949778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:37.949996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:37.950274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:37.950434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:37.950736 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:37.951406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:37.952082 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:37.976497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lazy-loading 'flavor' on Instance uuid f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:21:38.102069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:38.110350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-682f7c63-a5ac-460a-8080-ad6c098baeae tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.173198 Jun 24 04:21:38.110931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 345/717] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:37 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:38.289588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-96debd20-1152-4fd4-b8ae-6e5413b9a058 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/action" status: 200 len: 32 microversion: 2.1 time: 0.352178 Jun 24 04:21:38.290199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 373/718] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:21:37 2022] POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/action => generated 32 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:21:38.299747 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:38.300667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:38.306750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:38.307196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:38.307960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:38.308391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:38.491692 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:38.500277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8070d432-bdf9-42d6-8862-d73ba6b6aae1 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.204549 Jun 24 04:21:38.500943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 346/719] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:38 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:39.129538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:39.130356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:39.136719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:39.137158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:39.137956 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:39.138393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:39.282087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:39.291877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5e929e91-83ba-4e7c-848d-0ab70a95923c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.167292 Jun 24 04:21:39.293459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 374/720] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:39 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:39.518070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:39.518926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:39.525611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:39.526051 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:39.526832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:39.527256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:39.658181 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:39.661686 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:39.666500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7885ca2d-e399-40b0-9cd4-461ce683e4a0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.152474 Jun 24 04:21:39.667051 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 347/721] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:39 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:40.309462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:40.310066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:40.316446 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:40.316885 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:40.317634 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:40.318059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:40.459760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:40.467842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f849846e-89cf-4e85-9ff4-bd8605bd46ed tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.162788 Jun 24 04:21:40.468399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 375/722] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:40 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:40.684077 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:40.684677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:40.692908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:40.693393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:40.701473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:40.701473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:40.833775 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:40.838700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7fae8f85-9fce-4a74-bddf-0ef140ee87c6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.158335 Jun 24 04:21:40.848371 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 348/723] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:40 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:41.484941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:41.485546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:41.492031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:41.492479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:41.493233 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:41.493667 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:41.632806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:41.641350 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ccc50efb-620d-4ff9-a7ff-89214395d3c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.160257 Jun 24 04:21:41.641921 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 376/724] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:41 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:41.855631 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:41.856256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:41.864847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:41.865291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:41.866048 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:41.866500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:41.996504 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:42.005061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c2307f60-43d5-45cd-8a85-2901a62582a5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.153350 Jun 24 04:21:42.005624 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 349/725] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:41 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:42.659284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:42.659890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:42.666254 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:42.666725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:42.667482 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:42.667908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:42.816646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:42.824494 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e377369f-1664-4e63-8c90-6e52ecd514f0 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.169822 Jun 24 04:21:42.825067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 377/726] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:42 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:43.022040 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:43.022575 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:43.029324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:43.029785 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:43.030579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:43.031016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:43.167787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:43.176589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-069f4de7-c5d0-470b-a222-01cb1bea5417 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.158511 Jun 24 04:21:43.177144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 350/727] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:43 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:43.848455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:43.849058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:43.855697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:43.856138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:43.856894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:43.857322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:43.999585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:44.007544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1d64d7a3-d0f3-4b01-95d8-6735a9bca659 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.163065 Jun 24 04:21:44.008089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 378/728] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:43 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:44.193458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:44.194059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:44.200472 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:44.200913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:44.202212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:44.202673 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:44.331270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:44.339103 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7794a7eb-ceb2-4ac6-bf9d-ce9b82188f3d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.149468 Jun 24 04:21:44.339663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 351/729] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:44 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:45.024677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:45.025307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:45.032399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:45.032838 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:45.033591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:45.034018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:45.171757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:45.179609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-989d83b1-c3c7-4e9e-97be-9d63f7f8612b tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1756 microversion: 2.1 time: 0.159114 Jun 24 04:21:45.180167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 379/730] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:45 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:45.356644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:45.357344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:45.364023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:45.364467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:45.365219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:45.365656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:45.497142 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:45.505877 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-effd715b-38c8-45ad-b8a6-397b059bc129 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.153131 Jun 24 04:21:45.506458 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 352/731] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:45 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:46.196864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:46.197505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:46.205059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:46.205505 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:46.206276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:46.206744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:46.354155 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:46.362560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a98ac25d-60a1-472a-b231-274a1a24587d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1759 microversion: 2.1 time: 0.169502 Jun 24 04:21:46.363121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 380/732] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:46 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:46.522973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:46.523886 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:46.531033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:46.531481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:46.532261 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:46.532696 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:46.665890 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:46.674664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-21445ff5-4101-4515-ba26-a2fd4c8d8838 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.155604 Jun 24 04:21:46.675227 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 353/733] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:46 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:47.347643 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:47.348160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:47.354498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.354932 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.355679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.356135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.373360 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:47.385759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-67e1986e-ac47-4f2f-beb3-1965dcfbb335 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments/0cf5c601-1542-4adb-b7e6-b6b35b6ddf1c" status: 200 len: 194 microversion: 2.20 time: 0.042233 Jun 24 04:21:47.386329 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 381/734] 10.222.0.16 () {60 vars in 1453 bytes} [Fri Jun 24 04:21:47 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments/0cf5c601-1542-4adb-b7e6-b6b35b6ddf1c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:21:47.448784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:47.449272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:47.455549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.455997 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.456756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.457192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.536415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lazy-loading 'services' on Instance uuid b085e856-e8d0-451d-be61-532ea491655b {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:21:47.691910 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:47.692610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:47.699180 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.699641 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.700387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.700813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.786546 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-516e0663-a05d-456b-b626-1a740d05fbb5 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments/0cf5c601-1542-4adb-b7e6-b6b35b6ddf1c" status: 202 len: 0 microversion: 2.20 time: 0.341461 Jun 24 04:21:47.787140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 354/735] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jun 24 04:21:47 2022] DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments/0cf5c601-1542-4adb-b7e6-b6b35b6ddf1c => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:21:47.796066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:47.797141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:47.803913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.804228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.804990 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:47.805413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:47.834948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:47.835105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b73015ad-bf37-4618-8fc1-c58c59fe3ea4 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043385 Jun 24 04:21:47.835544 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 355/736] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jun 24 04:21:47 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 04:21:47.844394 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-11b8470c-6a87-44ab-b58e-7b184fff7422 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.156401 Jun 24 04:21:47.844951 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 382/737] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:47 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:48.847414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:48.848354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:48.855085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:48.855528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:48.856339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:48.856768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:48.861189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:48.861809 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:48.868535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:48.868980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:48.869751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:48.870185 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:48.886604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0ab83546-f391-4daa-88a1-1ae8d8bbab28 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043124 Jun 24 04:21:48.887402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 356/738] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jun 24 04:21:48 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:21:49.005657 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:49.014720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-717ce999-dffa-4cb4-89db-cfc5261deab2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.157105 Jun 24 04:21:49.015295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 383/739] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:48 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:49.899265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:49.900169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:49.907112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:49.907584 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:49.908341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:49.908776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:49.938042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ffc94a9d-7dfe-4414-980a-43adc1df8e9f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042998 Jun 24 04:21:49.938628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 357/740] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jun 24 04:21:49 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:49.995619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:49.996090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:50.003096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.004010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.004273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.004702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.031423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:21:50.032305 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:50.033079 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:50.039107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.039485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.040292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.040731 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.179446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:50.187980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-98a23b36-d32e-4eb3-bd08-8488ab91931a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.159583 Jun 24 04:21:50.188562 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 358/741] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:50 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:50.460501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0bff33f6-f8cd-4408-b09c-e4ff8b33d452 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 204 len: 0 microversion: 2.20 time: 0.468307 Jun 24 04:21:50.461282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 384/742] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jun 24 04:21:49 2022] DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 04:21:50.469968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:50.470599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:50.476738 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.477187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.477951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:50.478409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:50.628323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:50.636214 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:50.637713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:50.638946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5be62609-38d0-4732-acbd-2c16abf33861 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.173408 Jun 24 04:21:50.639499 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 359/743] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:50 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:51.207469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:51.208154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:51.214797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:51.215236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:51.215989 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:51.216419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:51.344302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:51.352127 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-55766390-9689-4edb-abce-e351ae052d30 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.148857 Jun 24 04:21:51.352671 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 385/744] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:51 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:51.657861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:51.658502 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:51.664948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:51.665387 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:51.666140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:51.666596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:51.795551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:51.803527 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:51.805050 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:51.806208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-30cbd030-aabf-4148-9140-5706318ca29d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.152714 Jun 24 04:21:51.806870 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 360/745] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:51 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:52.369044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:52.369591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:52.376426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:52.376873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:52.377625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:52.378055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:52.509186 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:52.517717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d9d19be3-027a-4a7c-943c-64977e1362aa tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.152599 Jun 24 04:21:52.518247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 386/746] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:52 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:52.825011 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:52.825625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:52.832144 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:52.832579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:52.837712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:52.837712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:53.030999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:53.039484 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:53.040981 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:53.042150 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c35bc775-2ba9-49b8-a22b-9316946c26ab tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1723 microversion: 2.20 time: 0.221012 Jun 24 04:21:53.052773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 361/747] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:52 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:53.536486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:53.537098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:53.544530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:53.544530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:53.545339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:53.546307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:53.677553 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:53.686309 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1c04cbdf-343a-48dd-8813-a3bd281a54ea tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1734 microversion: 2.1 time: 0.153929 Jun 24 04:21:53.686935 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 387/748] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:53 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:53.822213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-59cc5e1b-f2f0-4d0d-8fe8-7f22981ed5dc req-d4fa894a-f1ed-4608-a49e-080f9ffa1cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b085e856-e8d0-451d-be61-532ea491655b", "name": "network-vif-deleted", "tag": "a4646799-84a1-4e0f-88f6-135dfd47c759"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:53.834465 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-59cc5e1b-f2f0-4d0d-8fe8-7f22981ed5dc req-d4fa894a-f1ed-4608-a49e-080f9ffa1cf3 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:53.835761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-59cc5e1b-f2f0-4d0d-8fe8-7f22981ed5dc req-d4fa894a-f1ed-4608-a49e-080f9ffa1cf3 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:53.847650 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-59cc5e1b-f2f0-4d0d-8fe8-7f22981ed5dc req-d4fa894a-f1ed-4608-a49e-080f9ffa1cf3 service nova] Creating event network-vif-deleted:a4646799-84a1-4e0f-88f6-135dfd47c759 for instance b085e856-e8d0-451d-be61-532ea491655b on hv-cinder-84684 Jun 24 04:21:53.852960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-59cc5e1b-f2f0-4d0d-8fe8-7f22981ed5dc req-d4fa894a-f1ed-4608-a49e-080f9ffa1cf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Jun 24 04:21:53.854817 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 362/749] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:54.061367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:54.062203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:54.068556 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.069283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:54.070256 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.070917 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:54.134923 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:54.143165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:54.144654 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:54.145799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-227b09a9-db85-40d3-8b40-1d9449989e21 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 200 len: 1365 microversion: 2.20 time: 0.089382 Jun 24 04:21:54.146351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 388/750] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:54 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:21:54.704653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:54.705446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:54.711706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.712146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:54.712918 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.713412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:54.852928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:54.861996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-09970351-8d40-4b04-9126-e55abee5d4ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1714 microversion: 2.1 time: 0.162279 Jun 24 04:21:54.862821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 363/751] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:54 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:54.969858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:54.970346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:54.976915 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.977366 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:54.978119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:54.978587 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.060547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] HTTP exception thrown: Cannot 'detach_volume' instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 while it is in vm_state rescued Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Request method failure captured: Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments/17b07ed1-c129-49a2-9dc4-dc19afed1898 HTTP/1.1 Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrfLeDs0YL0BnbM5EotfCr5iI8_vDun375_cszEgc4ui957KxXPLQy5zow7Mw244spOHbzeumdoLBKzZ6UmFdV516OR-bkvT0xWTgqkx1TNhDbUR9BqX5ssWgqCa_DGRPGkn-yJ2Vh5I6VsfaveJuQnEUQFevsw7KKWUonMn84Jo_k Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:21:55.062158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96e2b5a124bf48fd82e48ed79aa4eeed"}]}] Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: b158078d039a4979a9c0cf2be26c4b14 Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:21:55.063754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Cannot 'detach_volume' instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 while it is in vm_state rescued Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'server_id': 'f8df66c5-d6b4-4482-a7cd-7ddccb4c0675', 'id': '17b07ed1-c129-49a2-9dc4-dc19afed1898'} Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:21:55.064615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 while it is in vm_state rescued Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 while it is in vm_state rescued Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.066132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Returning 409 to user: Cannot 'detach_volume' instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 while it is in vm_state rescued {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:21:55.067346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-76e52bec-160d-41ec-92d2-27eec635c595 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments/17b07ed1-c129-49a2-9dc4-dc19afed1898" status: 409 len: 152 microversion: 2.1 time: 0.098290 Jun 24 04:21:55.067346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 389/752] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:21:54 2022] DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments/17b07ed1-c129-49a2-9dc4-dc19afed1898 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 04:21:55.072418 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:55.072944 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:55.079337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.079777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.080525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.080952 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.097856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:55.165002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:55.165599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:55.174647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.175090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.175844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.176270 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.189824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b HTTP/1.1 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:21:55.191704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:21:55.193335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'b085e856-e8d0-451d-be61-532ea491655b'} Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:21:55.194167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:21:55.195578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:21:55.196840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:21:55.196840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-19bab076-5f4d-4d4b-b202-e9bcb28fbcc7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 404 len: 111 microversion: 2.20 time: 0.032017 Jun 24 04:21:55.196840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 390/753] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:55 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 04:21:55.202002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2b940905-04f1-41e7-bce3-4a262a359d9e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '.version_select at 0x7fdfed2d99d0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:55.318578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2b940905-04f1-41e7-bce3-4a262a359d9e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193457245" status: 204 len: 0 microversion: 2.20 time: 0.120098 Jun 24 04:21:55.319091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 391/754] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Jun 24 04:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193457245 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 04:21:55.349427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2e327d86-4686-4b4d-bbaa-6b399e1969a7 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/action" status: 202 len: 0 microversion: 2.1 time: 0.280618 Jun 24 04:21:55.350401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 364/755] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:21:55 2022] POST /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:21:55.359450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:55.360920 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:55.368220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.369107 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.369889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:55.370316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:55.549290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:55.557574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06397ffb-2711-4d79-929b-cce9a55c5f5d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1722 microversion: 2.1 time: 0.202291 Jun 24 04:21:55.558137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 392/756] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:55 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:56.216435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-833f1811-fbb8-4bf1-87b6-f3c8e467116b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: .version_select at 0x7fdfed18baf0>, body: {"keypair": {"name": "tempest-keypair-445687131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYr5rg/mUux52bKvzBfRW+kAgo+Ztd+BmF2B6n8aQUkT1ZOEPJZhbA4AVIV1R4dduU1EvuCZj/pkzd4H7sGdGoneR4kyUAymNHcVPT9dcCSN8Kv+TW2oGKNxTsVHT4iwA=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:56.220913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=60 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:21:56.231528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-833f1811-fbb8-4bf1-87b6-f3c8e467116b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:21:56.235498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-833f1811-fbb8-4bf1-87b6-f3c8e467116b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for user 9ffa029a3b1e4919b00e58a9737816d2 and project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:21:56.330600 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-833f1811-fbb8-4bf1-87b6-f3c8e467116b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118914 Jun 24 04:21:56.331208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 365/757] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Jun 24 04:21:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 04:21:56.575481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:56.577270 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:56.583750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:56.584237 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:56.592389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:56.592389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:56.743999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:56.752537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-693d69c6-38b2-4bc3-bc32-6735721b17b0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1722 microversion: 2.1 time: 0.180919 Jun 24 04:21:56.758504 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 393/758] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:56 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:57.771170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:57.772066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:57.780475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:57.780953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:57.781750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:57.782341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:57.937158 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:57.945794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e5a445a2-8e72-40c1-80fe-ab88ef4a0b82 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1722 microversion: 2.1 time: 0.178715 Jun 24 04:21:57.946735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 366/759] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:57 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:21:58.794232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-942181540", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1499097c-b20d-4670-a290-7c6daddf6fa9"}], "security_groups": [{"name": "tempest-securitygroup--9624825"}], "key_name": "tempest-keypair-445687131", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:21:58.895523 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] validate_networks() for [('1499097c-b20d-4670-a290-7c6daddf6fa9', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:21:58.964135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:58.964685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:58.971887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:58.972336 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:58.973098 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:58.973530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:59.104606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:59.112692 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-759bf70f-b53a-4633-9171-99c77af0c11f tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1728 microversion: 2.1 time: 0.152511 Jun 24 04:21:59.113260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 367/760] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:21:58 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:21:59.129090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:59.129605 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:59.135747 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:59.136203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:59.137024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:59.137476 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:59.217064 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e46e920d-b1a9-476c-b687-5ed96efc52ae tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091735 Jun 24 04:21:59.217649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 368/761] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:21:59 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:21:59.279511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:21:59.279945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:21:59.280416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:21:59.280825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:21:59.281234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:21:59.290292 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:59.290766 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:59.291588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:21:59.292046 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:21:59.309291 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:21:59.313790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Getting quotas for user 9ffa029a3b1e4919b00e58a9737816d2 and project d56eee171a5c4f728bec99eef1f3b0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:21:59.324733 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:21:59.327934 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:21:59.493198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8ab0d3ce-4f66-4349-86b4-3ac8f19925d8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.703095 Jun 24 04:21:59.499579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 394/762] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jun 24 04:21:58 2022] POST /compute/v2.1/servers => generated 399 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 04:21:59.504794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:21:59.507692 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:21:59.572735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:59.581530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:59.583064 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:21:59.584161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bf0e5796-b55e-4983-8295-b8ca1f20fbf1 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1280 microversion: 2.20 time: 0.083336 Jun 24 04:21:59.585213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 369/763] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:21:59 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:00.196761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-b24b7383-3a2e-4f7d-b7e8-ec4d1562cf48 req-62034a5a-5189-4047-8e5a-aec8e08ff423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:00.211455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-b24b7383-3a2e-4f7d-b7e8-ec4d1562cf48 req-62034a5a-5189-4047-8e5a-aec8e08ff423 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:00.212438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-b24b7383-3a2e-4f7d-b7e8-ec4d1562cf48 req-62034a5a-5189-4047-8e5a-aec8e08ff423 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:00.228789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-b24b7383-3a2e-4f7d-b7e8-ec4d1562cf48 req-62034a5a-5189-4047-8e5a-aec8e08ff423 service nova] Creating event network-changed:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:22:00.229619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-b24b7383-3a2e-4f7d-b7e8-ec4d1562cf48 req-62034a5a-5189-4047-8e5a-aec8e08ff423 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037192 Jun 24 04:22:00.230294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 395/764] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:00.603194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:00.604608 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:00.612244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:00.612815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:00.613658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:00.614763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:00.691223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:00.700226 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:00.702681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:00.703984 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2af81486-9cc0-4d39-ab53-3aee26196150 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1284 microversion: 2.20 time: 0.105631 Jun 24 04:22:00.705161 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 370/765] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:00 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:01.724445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:01.725143 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:01.732677 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:01.733583 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:01.734274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:01.734741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:01.802506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:01.809103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:01.811020 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:01.812056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7aaca15e-cb7d-4643-b799-2ed7dca7d696 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1340 microversion: 2.20 time: 0.092611 Jun 24 04:22:01.812611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 396/766] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:01 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:02.246806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-f8ff22fe-220c-4695-9672-59eb2f5e6ea4 req-3c2aae8a-d3aa-46dd-bf46-46aa0c283e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:02.256618 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-f8ff22fe-220c-4695-9672-59eb2f5e6ea4 req-3c2aae8a-d3aa-46dd-bf46-46aa0c283e86 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:02.257131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-f8ff22fe-220c-4695-9672-59eb2f5e6ea4 req-3c2aae8a-d3aa-46dd-bf46-46aa0c283e86 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:02.273070 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-f8ff22fe-220c-4695-9672-59eb2f5e6ea4 req-3c2aae8a-d3aa-46dd-bf46-46aa0c283e86 service nova] Creating event network-changed:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:22:02.278271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-f8ff22fe-220c-4695-9672-59eb2f5e6ea4 req-3c2aae8a-d3aa-46dd-bf46-46aa0c283e86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035639 Jun 24 04:22:02.280091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 371/767] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:02.829902 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:02.837777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:02.837777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:02.837777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:02.838534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:02.838771 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:02.972871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:02.981840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:02.983519 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:02.984636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e18adcbd-acdf-40c2-aea0-4494c553a7cc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.159267 Jun 24 04:22:02.985451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 397/768] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:02 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:04.004568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:04.005265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:04.011618 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:04.012071 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:04.012844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:04.013388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:04.227525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:04.236414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:04.237915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:04.239031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c08480a7-2521-4c3f-b450-3fe1703b425c tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.239223 Jun 24 04:22:04.239591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 372/769] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:03 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:04.303933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-be786550-8e58-4d0f-b841-40dcd98bfb96 req-5c3f5200-7729-42d1-a64f-5e4d87b6e2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:04.313656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-be786550-8e58-4d0f-b841-40dcd98bfb96 req-5c3f5200-7729-42d1-a64f-5e4d87b6e2d8 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:04.314095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-be786550-8e58-4d0f-b841-40dcd98bfb96 req-5c3f5200-7729-42d1-a64f-5e4d87b6e2d8 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:04.331093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-be786550-8e58-4d0f-b841-40dcd98bfb96 req-5c3f5200-7729-42d1-a64f-5e4d87b6e2d8 service nova] Creating event network-changed:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:22:04.335834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-be786550-8e58-4d0f-b841-40dcd98bfb96 req-5c3f5200-7729-42d1-a64f-5e4d87b6e2d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035922 Jun 24 04:22:04.337314 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 398/770] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:05.256350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:05.256873 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:05.264163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:05.264608 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:05.265365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:05.265793 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:05.408477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:05.416390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:05.417865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:05.418979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5aa04bb3-ea49-4501-94ec-fa5d7729fd93 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.166613 Jun 24 04:22:05.420512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 373/771] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:05 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:06.438702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:06.439389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:06.441308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:06.446169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:06.446658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:06.447423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:06.447858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:06.582015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:06.590861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:06.592598 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:06.593704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-28f23fb5-e10c-4020-a190-719f9e6e70b0 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.160417 Jun 24 04:22:06.594250 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 399/772] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:06 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:07.611409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:07.612015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:07.618786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:07.619252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:07.620009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:07.620464 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:07.751386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:07.759439 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:07.760930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:07.762044 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a992f8d9-87bd-4f3c-b4d4-eaaf6f7038e9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.154526 Jun 24 04:22:07.762639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 374/773] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:07 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:07.850550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-0855832e-b2c5-4fec-82a3-93e447739028 req-0d479575-b02a-44c4-8224-e0a624eb341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "name": "network-vif-plugged", "status": "completed", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:07.860170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0855832e-b2c5-4fec-82a3-93e447739028 req-0d479575-b02a-44c4-8224-e0a624eb341c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:07.860614 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-0855832e-b2c5-4fec-82a3-93e447739028 req-0d479575-b02a-44c4-8224-e0a624eb341c service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:07.864391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:07.871484 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-0855832e-b2c5-4fec-82a3-93e447739028 req-0d479575-b02a-44c4-8224-e0a624eb341c service nova] Creating event network-vif-plugged:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:22:07.876567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-0855832e-b2c5-4fec-82a3-93e447739028 req-0d479575-b02a-44c4-8224-e0a624eb341c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030243 Jun 24 04:22:07.877129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 400/774] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:08.780337 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:08.780945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:08.788121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:08.792741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:08.792741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:08.792741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:08.921645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:08.930164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:08.931725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:08.932835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-21134a37-f8c3-446d-af94-573876657de3 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1403 microversion: 2.20 time: 0.156404 Jun 24 04:22:08.933396 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 375/775] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:08 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:09.948427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:09.949182 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:09.953294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:09.953985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:09.961760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:09.962603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:09.963409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:09.963844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:10.098577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:10.106349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:10.110236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:10.110236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-089995da-1a71-4735-b1b8-fcd956769189 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1595 microversion: 2.20 time: 0.162630 Jun 24 04:22:10.110236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 401/776] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:09 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:10.126770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:10.127271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:10.129236 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=6 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:10.134678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:10.135121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:10.135902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:10.136331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:10.214766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8f2e0cd1-b9e1-47dd-8a00-4b8dd204aabc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091880 Jun 24 04:22:10.215363 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 376/777] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jun 24 04:22:10 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:22:11.187775 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-d87b7458-6733-4276-8af4-833defd36ef5 req-0445e25a-5aac-49a9-93f3-a5398b1e56e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:11.196592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d87b7458-6733-4276-8af4-833defd36ef5 req-0445e25a-5aac-49a9-93f3-a5398b1e56e4 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:11.197026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d87b7458-6733-4276-8af4-833defd36ef5 req-0445e25a-5aac-49a9-93f3-a5398b1e56e4 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:11.208348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-d87b7458-6733-4276-8af4-833defd36ef5 req-0445e25a-5aac-49a9-93f3-a5398b1e56e4 service nova] Creating event network-changed:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:22:11.213269 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-d87b7458-6733-4276-8af4-833defd36ef5 req-0445e25a-5aac-49a9-93f3-a5398b1e56e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029069 Jun 24 04:22:11.213870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 402/778] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:14.027233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:14.027721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:14.033991 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:14.034466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:14.035230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:14.035664 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:14.059010 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-14510504-db06-4783-877d-d6368233072a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/ips" status: 200 len: 150 microversion: 2.1 time: 0.036806 Jun 24 04:22:14.059572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 377/779] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:22:14 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:15.640750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9547db3-dc94-4c36-9625-84cc68ed4805"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:15.641976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:15.648095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:15.648802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:15.649547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:15.649974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:16.504891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8064ec99-6459-4f92-a38f-1fb12eb43128 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868896 Jun 24 04:22:16.505513 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 403/780] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:22:15 2022] POST /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:20.366558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:20.367671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:20.375514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.375943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:20.376703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.377131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:20.406614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9118fb3b-3ba5-406e-9f58-2570d3678d32 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044993 Jun 24 04:22:20.407149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 378/781] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:20 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:22:20.469393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:20.469976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:20.476148 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.476593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:20.477348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.477780 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:20.503015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:20.751612 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8f32c808-cfb6-4bc0-8151-fb3806fd0b1e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 204 len: 0 microversion: 2.1 time: 0.286974 Jun 24 04:22:20.757446 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 404/782] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:20 2022] DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 04:22:20.765246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:20.765856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:20.771883 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.772327 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:20.773087 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:20.773880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:21.007333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:21.014844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-07a35708-0259-4d02-b221-2affb7e3fca5 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1672 microversion: 2.1 time: 0.254237 Jun 24 04:22:21.015400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 379/783] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:20 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:22.032634 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:22.033260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:22.040070 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:22.040511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:22.041268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:22.041694 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:22.172067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:22.179492 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-162a970f-f713-4ace-96e8-f1b75ea9b540 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1672 microversion: 2.1 time: 0.151211 Jun 24 04:22:22.180051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 405/784] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:22 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:23.196972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:23.197578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:23.204189 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:23.204633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:23.205385 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:23.205818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:23.338517 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:23.346852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0ec18f65-019c-4073-8090-e45e2a4a1da1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1672 microversion: 2.1 time: 0.153766 Jun 24 04:22:23.347417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 380/785] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:23 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:24.365069 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:24.365912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:24.376238 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:24.376697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:24.377484 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:24.377926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:24.517467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:24.525561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0fa1208b-92ad-4db8-b1cb-770ae258f88e tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1672 microversion: 2.1 time: 0.165767 Jun 24 04:22:24.526346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 406/786] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:24 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:25.043186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9547db3-dc94-4c36-9625-84cc68ed4805"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:25.046019 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:25.052969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.053416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.054401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.054842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.141928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: POST /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments HTTP/1.1 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 74 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:25.143807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {"volumeAttachment": {"volumeId": "b9547db3-dc94-4c36-9625-84cc68ed4805"}} Jun 24 04:22:25.145217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'server_id': 'f9ac8aeb-d87b-48df-9a78-d17d9a2967a3', 'body': {'volumeAttachment': {'volumeId': 'b9547db3-dc94-4c36-9625-84cc68ed4805'}}} Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:25.146024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:25.150930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 400 to user: Invalid volume: volume b9547db3-dc94-4c36-9625-84cc68ed4805 is already attached to instances: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c5cb208b-186a-4e39-a894-4797dcac8819 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106267 Jun 24 04:22:25.152404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 381/787] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:22:25 2022] POST /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:22:25.172814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-1d5610d5-307b-43e1-acd6-cae796159d0d req-a5e382b9-e47d-47cb-9acc-f03bd08df952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95960fad-f7dd-4195-97e2-b8519a0ac2d3", "name": "network-vif-deleted", "tag": "743a00dc-b28e-4621-9d5a-757c991d77fb"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:25.180742 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1d5610d5-307b-43e1-acd6-cae796159d0d req-a5e382b9-e47d-47cb-9acc-f03bd08df952 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.187029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1d5610d5-307b-43e1-acd6-cae796159d0d req-a5e382b9-e47d-47cb-9acc-f03bd08df952 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.192463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-1d5610d5-307b-43e1-acd6-cae796159d0d req-a5e382b9-e47d-47cb-9acc-f03bd08df952 service nova] Creating event network-vif-deleted:743a00dc-b28e-4621-9d5a-757c991d77fb for instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 on hv-cinder-84684 Jun 24 04:22:25.197832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-1d5610d5-307b-43e1-acd6-cae796159d0d req-a5e382b9-e47d-47cb-9acc-f03bd08df952 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029786 Jun 24 04:22:25.201713 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 407/788] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:25.226399 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:25.226399 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:25.229839 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.230293 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.231093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.231520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.318649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:25.324824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'services' on Instance uuid f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:25.525662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f3093305-63e6-4997-8198-728625629fab tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments/b9547db3-dc94-4c36-9625-84cc68ed4805" status: 202 len: 0 microversion: 2.1 time: 0.308804 Jun 24 04:22:25.526230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 382/789] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:22:25 2022] DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments/b9547db3-dc94-4c36-9625-84cc68ed4805 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:25.536475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:25.537822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:25.545434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.547369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.547493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:25.547585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.548038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.548177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:25.555629 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.556075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.556838 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.557401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.578734 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d0cbbb54-b705-4f88-b18e-923adf9aef14 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Jun 24 04:22:25.579315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 408/790] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:25 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:25.595393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:25.595847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:25.596295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lazy-loading 'fault' on Instance uuid 95960fad-f7dd-4195-97e2-b8519a0ac2d3 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:25.640277 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:25.647908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-156c54ac-f4f6-4c55-a2cf-0389d9caf09f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 200 len: 1327 microversion: 2.1 time: 0.106711 Jun 24 04:22:25.648737 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 383/791] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:25 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:26.591150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:26.592074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:26.599388 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:26.599840 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:26.600604 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:26.601044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:26.630777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e0d3658d-dfb4-431d-8ff6-b5d098ba6bf0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Jun 24 04:22:26.631327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 409/792] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:26 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:26.665983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:26.666605 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:26.668945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:26.674793 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:26.680209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:26.680209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:26.680209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:26.691066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 HTTP/1.1 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:26.692662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:22:26.694266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '95960fad-f7dd-4195-97e2-b8519a0ac2d3'} Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:26.695239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:22:26.696684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:26.698235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:26.698235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0bfcb418-db74-4fd6-aed3-ac14cc07e973 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 404 len: 111 microversion: 2.1 time: 0.031917 Jun 24 04:22:26.698235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 384/793] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:26 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:26.703832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9c1622d9-c608-463c-b09b-9993e4f95ac8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '.version_select at 0x7fdff1abaa60>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:26.769198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9c1622d9-c608-463c-b09b-9993e4f95ac8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125652823" status: 202 len: 0 microversion: 2.1 time: 0.069987 Jun 24 04:22:26.769768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 410/794] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jun 24 04:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125652823 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:27.599673 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-04c1e6df-df8c-462c-b029-01074ae0785f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: .version_select at 0x7fdfed18d5e0>, body: {"keypair": {"name": "tempest-keypair-1728025458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMIbVAbB6n8bHe1dULoR81C3i4aUTubkqYrgkGp4oQ86AhFGaxc4n7FIH8QD2bJjP5KiQ8LY8VWKE5RTrE3hXxG+P0NQ0EFbkbTJmNsANvAMtqNxhEcbSccj4uITSSp0w=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:27.614051 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-04c1e6df-df8c-462c-b029-01074ae0785f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:22:27.617852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-04c1e6df-df8c-462c-b029-01074ae0785f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for user 066d1521db464b4996f6daf6548dcc38 and project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:22:27.643282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:27.644186 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:27.651113 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.651556 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.652302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.652728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.682680 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9348a445-ecf5-451c-8385-41637ffe7b89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044329 Jun 24 04:22:27.683229 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 411/795] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:27 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 04:22:27.720716 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-04c1e6df-df8c-462c-b029-01074ae0785f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125127 Jun 24 04:22:27.721329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 385/796] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:22:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:27.743090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:27.743675 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:27.750463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.751047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.752015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.752463 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.777892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:27.847110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1655786945"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:27.847666 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:27.853767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.854231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.855002 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:27.855432 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:27.991895 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.network.security_group_api [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Removing security group 3126237a-d470-4df6-b2d3-1f030e73085d from port 119eca9e-1070-4304-801e-2d66cb712073 Jun 24 04:22:28.056684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-79e861c7-22e5-466f-96f4-082425893088 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 204 len: 0 microversion: 2.1 time: 0.317528 Jun 24 04:22:28.057383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 412/797] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:27 2022] DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:28.066796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:28.067669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:28.074529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:28.074978 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:28.075738 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:28.076167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:28.261515 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:28.274146 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-040d7568-9e77-4366-a0b3-58e2e9bc5662 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1682 microversion: 2.1 time: 0.211705 Jun 24 04:22:28.275402 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 413/798] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:28 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:28.517848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5419a20f-71f6-4f3b-b176-e9d85bf432e8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action" status: 202 len: 0 microversion: 2.1 time: 0.675698 Jun 24 04:22:28.518657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 386/799] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:22:27 2022] POST /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:22:28.534197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-f722481f-5c49-4e10-a665-4716833e6bf1 req-d42306e1-71c6-4e42-95f0-4a7f492058ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:28.544875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-f722481f-5c49-4e10-a665-4716833e6bf1 req-d42306e1-71c6-4e42-95f0-4a7f492058ee service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:28.545319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-f722481f-5c49-4e10-a665-4716833e6bf1 req-d42306e1-71c6-4e42-95f0-4a7f492058ee service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:28.583257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-f722481f-5c49-4e10-a665-4716833e6bf1 req-d42306e1-71c6-4e42-95f0-4a7f492058ee service nova] Creating event network-changed:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:22:28.591608 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-f722481f-5c49-4e10-a665-4716833e6bf1 req-d42306e1-71c6-4e42-95f0-4a7f492058ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064685 Jun 24 04:22:28.592530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 414/800] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:29.294164 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:29.295460 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:29.305760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:29.306561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:29.307534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:29.308148 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:29.605428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:29.617316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4d42fcd3-ab77-45ac-9d45-1de71d7002da tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1682 microversion: 2.1 time: 0.327468 Jun 24 04:22:29.618013 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 387/801] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:29 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:30.317445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:30.318060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:30.325278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.325727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.326784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.328014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.343518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1685471143", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7b2c59a-0555-4ea1-82f3-82731a83d232"}], "security_groups": [{"name": "tempest-securitygroup--127942317"}], "key_name": "tempest-keypair-1728025458", "user_data": "}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:30.423294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:30.427497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lazy-loading 'services' on Instance uuid 47c7618d-d975-4f1d-b27f-30ff00022f6b {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:30.686593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d7a2a437-cc2d-41e3-a4d8-a4c225ede91a tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments/02e0d886-5ab6-4880-b145-f66ec8f9a110" status: 202 len: 0 microversion: 2.1 time: 0.370329 Jun 24 04:22:30.686593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 415/802] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:22:30 2022] DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments/02e0d886-5ab6-4880-b145-f66ec8f9a110 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:30.700183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:30.701878 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:30.709991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.714636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.714636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.714636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.898763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:30.903596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9a8b38e-8029-4291-9d35-d314cc221f7c tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1682 microversion: 2.1 time: 0.218656 Jun 24 04:22:30.904908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 416/803] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:30 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:30.908783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.network.neutron [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] validate_networks() for [('e7b2c59a-0555-4ea1-82f3-82731a83d232', None, None, None, None, None)] {{(pid=118330) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:22:30.911172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:30.912323 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:30.919698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.921798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.921798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.922471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.952847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a5b5db67-60fa-434c-a73f-3ecd8f8e9f05 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Jun 24 04:22:30.959429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 417/804] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:30 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:30.959429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-52999131-a979-4d7c-87b6-74c1599fe7d0 req-c18fb980-a36d-4c56-b7a6-43b94affd350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:30.966020 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-52999131-a979-4d7c-87b6-74c1599fe7d0 req-c18fb980-a36d-4c56-b7a6-43b94affd350 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:30.966354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-52999131-a979-4d7c-87b6-74c1599fe7d0 req-c18fb980-a36d-4c56-b7a6-43b94affd350 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:30.978345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-52999131-a979-4d7c-87b6-74c1599fe7d0 req-c18fb980-a36d-4c56-b7a6-43b94affd350 service nova] Creating event network-changed:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:22:30.983268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-52999131-a979-4d7c-87b6-74c1599fe7d0 req-c18fb980-a36d-4c56-b7a6-43b94affd350 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028714 Jun 24 04:22:30.983986 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 418/805] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:31.753706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Flavor limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:22:31.754196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Image limits 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:22:31.755149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Flavor pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:22:31.755564 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Image pref 0:0:0 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:22:31.756167 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.virt.hardware [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:22:31.767851 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:31.767971 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:31.768707 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:31.769148 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:31.789938 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:22:31.794599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Getting quotas for user 066d1521db464b4996f6daf6548dcc38 and project ba92bd9c1afc47008582aba7ec0c5266. Resources: {'instances', 'ram', 'cores'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:22:31.807096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Going to run 1 instances... {{(pid=118330) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:22:31.809426 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:22:32.007242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-412cd435-650d-42d5-91a0-e72a071d6175 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.667855 Jun 24 04:22:32.019864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 388/806] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:22:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 04:22:32.025037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:32.026028 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:32.048586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.048586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.048830 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.049153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.085302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8f47ec36-df77-4378-a344-50b86756d675 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064976 Jun 24 04:22:32.086416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 389/807] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:32 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:22:32.088900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:32.089711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:32.093159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-464d824f-6e59-4151-b49d-1dc9bdd1bfc4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:32.094005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-464d824f-6e59-4151-b49d-1dc9bdd1bfc4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:32.098255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.098985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.100067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.100602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.176020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-464d824f-6e59-4151-b49d-1dc9bdd1bfc4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:32.184468 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-464d824f-6e59-4151-b49d-1dc9bdd1bfc4 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1238 microversion: 2.1 time: 0.096826 Jun 24 04:22:32.188156 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 390/808] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:32 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:32.190924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:32.198954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bb317477-c678-43bf-a19a-2392c6fcf0b1 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 200 len: 1614 microversion: 2.1 time: 0.280052 Jun 24 04:22:32.200773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 419/809] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:31 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 1614 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:32.203583 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:32.208026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:32.215659 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.216104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.216924 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:32.217523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:32.319425 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] HTTP exception thrown: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b is not attached to volume 02e0d886-5ab6-4880-b145-f66ec8f9a110 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Request method failure captured: Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments/02e0d886-5ab6-4880-b145-f66ec8f9a110 HTTP/1.1 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTtHAPWKp3oOIBdqGyLSu-hwwnZDMcxFG18Z5VO3ENQHDoMVpsazwZrDc3HE-zHF4khqTR0UI_9-SU1FBcDL99_5tjHmp5PzN9cQiVMxLEP3Er7LWQesxQte3gHBltcETsVsEJgzFYIBgBb6KJ4ot39tduUqlOLMvn2MfirwiVB1ySM Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: d51a251ca7084b2bb07d808026cccd67 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:32.321934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d51a251ca7084b2bb07d808026cccd67"}]}] Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: d51a251ca7084b2bb07d808026cccd67 Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestMinimumBasicScenario-1911692833-project Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 4fb36d1e057543a3abcf6d6c2564d9ae Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestMinimumBasicScenario-1911692833-project Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:32.323509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b is not attached to volume 02e0d886-5ab6-4880-b145-f66ec8f9a110 Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'server_id': '47c7618d-d975-4f1d-b27f-30ff00022f6b', 'id': '02e0d886-5ab6-4880-b145-f66ec8f9a110'} Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02e0d886-5ab6-4880-b145-f66ec8f9a110. Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:32.324376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b is not attached to volume 02e0d886-5ab6-4880-b145-f66ec8f9a110 Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b is not attached to volume 02e0d886-5ab6-4880-b145-f66ec8f9a110 Jun 24 04:22:32.325746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:32.330975 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Returning 404 to user: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b is not attached to volume 02e0d886-5ab6-4880-b145-f66ec8f9a110 {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:32.334551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1c76b7a4-3a61-4fde-96e2-3e1c707dee55 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments/02e0d886-5ab6-4880-b145-f66ec8f9a110" status: 404 len: 154 microversion: 2.1 time: 0.143288 Jun 24 04:22:32.339663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 391/810] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:22:32 2022] DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b/os-volume_attachments/02e0d886-5ab6-4880-b145-f66ec8f9a110 => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:33.009000 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-c2735d3e-3131-4fa3-8d97-8dfeb0437683 req-5e1cf34e-b2d4-4fd4-b1ef-6af0e4f930a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ac8aeb-d87b-48df-9a78-d17d9a2967a3", "name": "network-vif-deleted", "tag": "54b8f8a3-1d8e-4be9-9c0c-2bb12134879a"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:33.018824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-c2735d3e-3131-4fa3-8d97-8dfeb0437683 req-5e1cf34e-b2d4-4fd4-b1ef-6af0e4f930a6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.023449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-c2735d3e-3131-4fa3-8d97-8dfeb0437683 req-5e1cf34e-b2d4-4fd4-b1ef-6af0e4f930a6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.031812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-c2735d3e-3131-4fa3-8d97-8dfeb0437683 req-5e1cf34e-b2d4-4fd4-b1ef-6af0e4f930a6 service nova] Creating event network-vif-deleted:54b8f8a3-1d8e-4be9-9c0c-2bb12134879a for instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 on hv-cinder-84684 Jun 24 04:22:33.051424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-c2735d3e-3131-4fa3-8d97-8dfeb0437683 req-5e1cf34e-b2d4-4fd4-b1ef-6af0e4f930a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046098 Jun 24 04:22:33.051968 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 420/811] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:33.205024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:33.205632 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:33.212703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.218603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.218603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.218603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.223810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:33.225293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:33.233815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.234746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.236623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.237399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.255124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 HTTP/1.1 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:22:33.256859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:22:33.258190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f9ac8aeb-d87b-48df-9a78-d17d9a2967a3'} Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:33.258972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:22:33.260340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:22:33.261471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:33.261471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b299ad5a-25c9-4559-b3e3-5543bf5cef9f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 404 len: 111 microversion: 2.1 time: 0.039676 Jun 24 04:22:33.261471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 421/812] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:33 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:33.270223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ef80046d-405f-48b6-ab02-3924984e2c82 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '.version_select at 0x7fdff1a8f280>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:33.284183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:33.291611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0545e74d-d2c1-449e-9935-9fad7c584edb tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1242 microversion: 2.1 time: 0.091262 Jun 24 04:22:33.292170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 392/813] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:33 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:33.383205 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ef80046d-405f-48b6-ab02-3924984e2c82 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481669819" status: 202 len: 0 microversion: 2.1 time: 0.118228 Jun 24 04:22:33.383979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 422/814] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jun 24 04:22:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481669819 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:33.659031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:33.659763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:33.666635 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.667078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.668033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:33.668469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:33.695085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:33.999284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-49427731-1bfb-4098-a3b6-227466266845 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 204 len: 0 microversion: 2.1 time: 0.343978 Jun 24 04:22:33.999904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 393/815] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:33 2022] DELETE /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:34.008017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:34.008629 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:34.015333 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.015776 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.016537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.016972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.155893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:34.164435 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b7aa9ea6-ea7c-41b2-b98e-51d4a1fb446e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1553 microversion: 2.1 time: 0.160340 Jun 24 04:22:34.165002 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 423/816] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:34 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:34.216614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4161e2a0-5c9a-49ac-a76e-fe920b376129 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: .version_select at 0x7fdfed18b820>, body: {"keypair": {"name": "tempest-keypair-2034357895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFqhMZ+yUKsMmQEl9WX4+snAtNPAJqJ6FwxBh7UZ9xDE7eiVDfljiIWX8b+XxQHxkV7qakGi8uH0buFb5+BtRWrFDqebE1X1PGP/TcIXca30qlUewaAryjMBJK7Hq3Tg=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:34.232084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-4161e2a0-5c9a-49ac-a76e-fe920b376129 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:22:34.236414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-4161e2a0-5c9a-49ac-a76e-fe920b376129 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:22:34.309047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:34.309607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:34.315778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.316221 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.316979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.317409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.347203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4161e2a0-5c9a-49ac-a76e-fe920b376129 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134669 Jun 24 04:22:34.348118 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 394/817] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:22:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:34.378796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:34.386271 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1e30bdd6-7a82-4340-aa5a-a144604c616a tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1290 microversion: 2.1 time: 0.081249 Jun 24 04:22:34.386862 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 424/818] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:34 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:34.614037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:34.614681 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:34.620999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.621445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.622213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.622766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.709657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lazy-loading 'services' on Instance uuid f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:34.922039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7a0d35e8-f83b-41e8-b94f-030d5ad681fc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments/17b07ed1-c129-49a2-9dc4-dc19afed1898" status: 202 len: 0 microversion: 2.1 time: 0.311371 Jun 24 04:22:34.922683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 395/819] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:22:34 2022] DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments/17b07ed1-c129-49a2-9dc4-dc19afed1898 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:34.931176 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:34.932158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:34.943537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.943537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.943537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:34.943537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:34.972619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6fbb4512-5467-4e7d-8e38-fbdff7398a57 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Jun 24 04:22:34.973173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 425/820] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:34 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:35.183568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:35.184267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:35.191335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:35.191783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:35.192551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:35.192985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:35.341592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:35.349855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-888c24ba-5fd1-4688-8d51-bc14efe086c1 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1553 microversion: 2.1 time: 0.170520 Jun 24 04:22:35.350438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 396/821] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:35 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:35.463846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:35.464455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:35.472456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:35.472897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:35.473648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:35.474075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:35.540194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:35.548474 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-50c5de96-de09-49b0-86b2-4b9b6be672f9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1290 microversion: 2.1 time: 0.148245 Jun 24 04:22:35.549037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 426/822] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:35 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:36.047270 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:36.048264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:36.054301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.054779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.055529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.055955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.085846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a609112f-995d-43dd-b177-534a9a225c5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105466 Jun 24 04:22:36.086414 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 397/823] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:35 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:36.368127 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:36.368844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:36.375273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.377834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.377834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.377834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.538169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:36.547235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9b6d8c17-a91b-4dd9-bc2e-4cedee75e5f8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1553 microversion: 2.1 time: 0.182608 Jun 24 04:22:36.547907 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 427/824] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:36 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:36.567301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:36.567301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:36.580160 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.580606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.581598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:36.582028 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:36.694200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:36.708320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5cc8bd2a-7151-4b3c-981a-701fa33f7796 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1298 microversion: 2.1 time: 0.146973 Jun 24 04:22:36.719105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 398/825] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:36 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:36.740636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-233607117", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7"}], "security_groups": [{"name": "tempest-securitygroup--1958807841"}], "key_name": "tempest-keypair-2034357895", "user_data": "}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:36.873642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] validate_networks() for [('a43bf3e4-fe7e-43d1-8369-2c0f79f52ed7', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:22:37.100573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:37.102036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:37.110866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.111393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.112203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.112640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.149107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cd4e5eb4-ec4b-4e28-99a4-be453e3abc43 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055255 Jun 24 04:22:37.153266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 399/826] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:37 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:22:37.461188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:22:37.461778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:22:37.462791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:22:37.463204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:22:37.463670 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:22:37.474798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.475239 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.476032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.481813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.509295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:22:37.509295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Getting quotas for user 114d227e9645409e9082cf9b09b05c3b and project ab7130ecbc4d487db66baebeab8550b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:22:37.520140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:22:37.522625 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:22:37.564588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:37.565192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:37.572092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.572837 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.573677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.574114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.625275 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f35f5f6c-0be2-42b0-9ce5-0d12d7ddabf6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.891039 Jun 24 04:22:37.630873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 428/827] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:22:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:22:37.638409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c3f704bc-7621-4d7d-bb87-7f9d14dd2192 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:37.639032 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c3f704bc-7621-4d7d-bb87-7f9d14dd2192 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:37.700381 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c3f704bc-7621-4d7d-bb87-7f9d14dd2192 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:37.708267 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c3f704bc-7621-4d7d-bb87-7f9d14dd2192 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1241 microversion: 2.1 time: 0.074010 Jun 24 04:22:37.710888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 429/828] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:37 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:37.728066 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:37.728828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:37.737757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.738721 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.740604 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.741617 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:37.810577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:37.819356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-04a0f31c-1236-4eae-a208-5db5505362db tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1296 microversion: 2.1 time: 0.094453 Jun 24 04:22:37.819356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 430/829] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:37 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:37.872852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:37.877191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:37.882061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0281264e-ff2c-4f01-b3c9-f1b23b17536c tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1553 microversion: 2.1 time: 0.321484 Jun 24 04:22:37.892253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 400/830] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:37 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:37.990377 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-72f890f8-1bce-4410-bcf5-050fe5625a32 req-b99333b4-a87c-47a7-9135-dbcc7d8a4ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c7618d-d975-4f1d-b27f-30ff00022f6b", "name": "network-vif-deleted", "tag": "119eca9e-1070-4304-801e-2d66cb712073"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:37.998481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-72f890f8-1bce-4410-bcf5-050fe5625a32 req-b99333b4-a87c-47a7-9135-dbcc7d8a4ef5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:37.998979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-72f890f8-1bce-4410-bcf5-050fe5625a32 req-b99333b4-a87c-47a7-9135-dbcc7d8a4ef5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.011832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-72f890f8-1bce-4410-bcf5-050fe5625a32 req-b99333b4-a87c-47a7-9135-dbcc7d8a4ef5 service nova] Creating event network-vif-deleted:119eca9e-1070-4304-801e-2d66cb712073 for instance 47c7618d-d975-4f1d-b27f-30ff00022f6b on hv-cinder-84684 Jun 24 04:22:38.017389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-72f890f8-1bce-4410-bcf5-050fe5625a32 req-b99333b4-a87c-47a7-9135-dbcc7d8a4ef5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031353 Jun 24 04:22:38.018040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 431/831] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:38.160331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.161273 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.176606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.177065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.177839 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.182561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.228555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2000d3bb-c892-4606-9a90-a80bdac906c4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072513 Jun 24 04:22:38.236018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 401/832] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:22:38 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:22:38.319507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.320877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.323047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:38.339688 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.340254 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.340983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.341418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.384725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:38.716778 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-67f43499-6b93-48a4-9816-dc43d458c4e5 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 204 len: 0 microversion: 2.1 time: 0.401495 Jun 24 04:22:38.720390 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 432/833] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:38 2022] DELETE /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:38.725788 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.726393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.737075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.737785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.745569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.746287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.750112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.753290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.757919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.758364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.759340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.760093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.842954 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:38.851472 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-56a1554b-91ec-47cd-8052-35d4a55ffccb tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1245 microversion: 2.1 time: 0.119176 Jun 24 04:22:38.852036 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 433/834] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:38 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:38.856860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.857632 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.865078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.875846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.875846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.875846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.922824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:38.932300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bfe5b0a7-d652-45ea-a8d1-f16e94f92fa2 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1688 microversion: 2.1 time: 0.210424 Jun 24 04:22:38.932953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 402/835] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:38 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:38.937838 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:38.938511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:38.944796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.945243 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.946008 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.946470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.978855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:38.979303 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:38.979760 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lazy-loading 'fault' on Instance uuid 47c7618d-d975-4f1d-b27f-30ff00022f6b {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:39.016755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:39.025303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-14dafc76-7787-4658-ac80-9f7252dcca48 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.171987 Jun 24 04:22:39.025887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 434/836] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:38 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:39.045761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:39.058776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6c662ed6-3508-4ffd-8219-1f1751f93746 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1348 microversion: 2.1 time: 0.120074 Jun 24 04:22:39.058776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 403/837] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:38 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1348 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:39.869016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:39.869626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:39.876756 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:39.877199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:39.877955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:39.878407 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:39.896716 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:39.938427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:39.945627 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-941f74d1-a587-4409-b76c-c7658432f939 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1245 microversion: 2.1 time: 0.080474 Jun 24 04:22:39.946187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 435/838] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:39 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:39.948972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:39.949585 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:39.956732 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:39.957184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:39.957951 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:39.958405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.038852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-001733a3-8129-4117-8f85-f1e9358192e5 req-b92211ea-505e-44ef-a07a-6b458783e317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca634131-d896-451a-8213-b55471341fa6", "tag": "04c693b8-b0c5-4480-a278-08e6a78747c0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:40.051729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-001733a3-8129-4117-8f85-f1e9358192e5 req-b92211ea-505e-44ef-a07a-6b458783e317 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.052166 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-001733a3-8129-4117-8f85-f1e9358192e5 req-b92211ea-505e-44ef-a07a-6b458783e317 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.063991 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-001733a3-8129-4117-8f85-f1e9358192e5 req-b92211ea-505e-44ef-a07a-6b458783e317 service nova] Creating event network-changed:04c693b8-b0c5-4480-a278-08e6a78747c0 for instance ca634131-d896-451a-8213-b55471341fa6 on hv-cinder-84684 Jun 24 04:22:40.068777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-001733a3-8129-4117-8f85-f1e9358192e5 req-b92211ea-505e-44ef-a07a-6b458783e317 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038203 Jun 24 04:22:40.069365 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 436/839] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:40.074236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:40.074940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:40.083293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.083738 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.084495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.084924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.099313 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:40.106849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3098a6fd-164a-4507-b588-405f797bce5a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1688 microversion: 2.1 time: 0.161762 Jun 24 04:22:40.107407 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 404/840] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:39 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:40.112240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:40.112840 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:40.118758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.119203 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.119961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.120391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.151974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.152422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.152867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lazy-loading 'fault' on Instance uuid 47c7618d-d975-4f1d-b27f-30ff00022f6b {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:40.195946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:40.203680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5a1e14e5-7797-445c-b440-e35eeaec6878 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1348 microversion: 2.1 time: 0.095084 Jun 24 04:22:40.204244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 405/841] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:40 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:40.219905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:40.227287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f09bfbf8-2b98-4298-9cd6-809d5b459afc tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.156852 Jun 24 04:22:40.227847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 437/842] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:40 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:40.962607 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:40.963213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:40.969831 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.970281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:40.971059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:40.971492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.033825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:41.041339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-30ab2dd0-fb19-4f36-9ab8-ea1a09703e68 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1245 microversion: 2.1 time: 0.082696 Jun 24 04:22:41.041909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 406/843] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:40 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:41.123814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:41.125108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:41.131676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.132122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.132880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.133316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.221605 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:41.222211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:41.228291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.228748 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.229501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.229931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.259388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.259837 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.260288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lazy-loading 'fault' on Instance uuid 47c7618d-d975-4f1d-b27f-30ff00022f6b {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:41.267306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:41.275078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d2670735-5b9b-48ea-ba53-0d91a01f3af4 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1688 microversion: 2.1 time: 0.155096 Jun 24 04:22:41.275636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 438/844] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:41 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:41.279995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:41.281896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:41.287373 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.287816 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.288571 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:41.288999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:41.302777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb36d1e057543a3abcf6d6c2564d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51a251ca7084b2bb07d808026cccd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:41.310039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cf070722-c506-45fd-bac6-9291724b9e0d tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 200 len: 1348 microversion: 2.1 time: 0.093172 Jun 24 04:22:41.310628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 407/845] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:41 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:41.417183 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:41.424850 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c6235557-964c-4994-af24-85a8c42b364d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.148278 Jun 24 04:22:41.425403 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 439/846] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:41 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:42.058493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:42.059135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:42.060945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:42.067031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.067486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.068253 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.068695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.129430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:42.136805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-503dfdb8-c7ef-4c07-a54b-5bcf880c6266 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1245 microversion: 2.1 time: 0.082218 Jun 24 04:22:42.137356 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 408/847] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:42 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:42.292721 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:42.293357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:42.300623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.301073 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.301873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.302311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.329599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:42.330205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] [instance: 47c7618d-d975-4f1d-b27f-30ff00022f6b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:42.332194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:42.337137 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.337677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.338548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.338979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.354874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] HTTP exception thrown: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Request method failure captured: Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b HTTP/1.1 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTtHAPWKp3oOIBdqGyLSu-hwwnZDMcxFG18Z5VO3ENQHDoMVpsazwZrDc3HE-zHF4khqTR0UI_9-SU1FBcDL99_5tjHmp5PzN9cQiVMxLEP3Er7LWQesxQte3gHBltcETsVsEJgzFYIBgBb6KJ4ot39tduUqlOLMvn2MfirwiVB1ySM Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: d51a251ca7084b2bb07d808026cccd67 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:42.362259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d51a251ca7084b2bb07d808026cccd67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d51a251ca7084b2bb07d808026cccd67"}]}] Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: d51a251ca7084b2bb07d808026cccd67 Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1911692833 Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestMinimumBasicScenario-1911692833-project Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 4fb36d1e057543a3abcf6d6c2564d9ae Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestMinimumBasicScenario-1911692833-project Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. Jun 24 04:22:42.363928 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '47c7618d-d975-4f1d-b27f-30ff00022f6b'} Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:42.364820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. Jun 24 04:22:42.366581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:42.367962 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Returning 404 to user: Instance 47c7618d-d975-4f1d-b27f-30ff00022f6b could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:42.367962 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ee6714bf-6b8c-4110-a122-0437b8118c3e tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b" status: 404 len: 111 microversion: 2.1 time: 0.034093 Jun 24 04:22:42.367962 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 409/848] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:42 2022] GET /compute/v2.1/servers/47c7618d-d975-4f1d-b27f-30ff00022f6b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:42.369663 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-735c9410-585b-47f4-906b-3ce32c99d7c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] Calling method '.version_select at 0x7fdfed18baf0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:42.473476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:42.480700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-735c9410-585b-47f4-906b-3ce32c99d7c8 tempest-TestMinimumBasicScenario-1911692833 tempest-TestMinimumBasicScenario-1911692833-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1236940011" status: 202 len: 0 microversion: 2.1 time: 0.117202 Jun 24 04:22:42.481274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 410/849] 10.222.0.16 () {58 vars in 1271 bytes} [Fri Jun 24 04:22:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1236940011 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:42.486262 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6c2f029c-186a-45ff-8bcc-e4900038bcd3 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1688 microversion: 2.1 time: 0.197545 Jun 24 04:22:42.487230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 440/850] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:42 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:42.509547 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:42.510178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:42.520520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.521019 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.522566 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:42.523033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:42.853779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:42.861612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ab51eb63-e332-4286-a88b-a0ba725b50d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.379260 Jun 24 04:22:42.862386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 411/851] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:42 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:43.154965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:43.155594 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:43.161761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.162209 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.163015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.163448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.232435 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:43.240961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-22f67cb0-dec0-4400-af4e-d4f7f7517719 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1293 microversion: 2.1 time: 0.089333 Jun 24 04:22:43.241799 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 441/852] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:43 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:43.506346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:43.507026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:43.513482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.516066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.517129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.517727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.741451 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:43.751400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-807821aa-ddd2-4be8-9335-5d2bda0bd168 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1688 microversion: 2.1 time: 0.251758 Jun 24 04:22:43.751980 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 412/853] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:43 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1688 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:43.879586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:43.880668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:43.887030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.888024 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.888858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:43.889418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:43.978212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-1e998945-deba-441d-b032-725349e4c7e7 req-537ed17a-6df5-4af3-a9c7-d4d22541ee63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8df66c5-d6b4-4482-a7cd-7ddccb4c0675", "name": "network-vif-deleted", "tag": "1d7ea309-0291-442f-90a7-78afe6a88e5d"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:44.000937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-1e998945-deba-441d-b032-725349e4c7e7 req-537ed17a-6df5-4af3-a9c7-d4d22541ee63 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:44.001530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-1e998945-deba-441d-b032-725349e4c7e7 req-537ed17a-6df5-4af3-a9c7-d4d22541ee63 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:44.014437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-1e998945-deba-441d-b032-725349e4c7e7 req-537ed17a-6df5-4af3-a9c7-d4d22541ee63 service nova] Creating event network-vif-deleted:1d7ea309-0291-442f-90a7-78afe6a88e5d for instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 on hv-cinder-84684 Jun 24 04:22:44.024235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-1e998945-deba-441d-b032-725349e4c7e7 req-537ed17a-6df5-4af3-a9c7-d4d22541ee63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052380 Jun 24 04:22:44.025423 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 413/854] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:22:44.144122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:44.153541 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-458b469d-1170-4d35-a5cf-b19da6fb95cd tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.278039 Jun 24 04:22:44.155008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 442/855] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:43 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:44.255844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=16 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:44.260401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:44.261207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:44.268411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:44.269064 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:44.269915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:44.270443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:44.335772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:44.345306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d1f38459-4006-4751-839a-95bab187ce36 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1299 microversion: 2.1 time: 0.090524 Jun 24 04:22:44.346151 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 414/856] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:44 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:44.769743 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:44.770746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:44.778021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:44.779157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:44.780188 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:44.781539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:44.971877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:44.979950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ab8f24a3-4158-4773-8e11-6db584b7767a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 200 len: 1330 microversion: 2.1 time: 0.215296 Jun 24 04:22:44.990582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 443/857] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:44 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 1330 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:45.175134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:45.176462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:45.183444 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:45.184357 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:45.189603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:45.189603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:45.364067 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:45.364744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:45.382175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:45.386330 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:45.387855 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:45.394258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:45.415768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:45.429049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-43d9e416-ba43-4fe3-ac58-a7e63b0ea56d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.260390 Jun 24 04:22:45.438529 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 415/858] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:45 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:45.684650 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:45.704041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-999b18d9-8669-4868-aa62-30fca742a5bc tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.345372 Jun 24 04:22:45.723172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 444/859] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:45 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:45.997888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:45.998699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: f8df66c5-d6b4-4482-a7cd-7ddccb4c0675] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:46.005508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.006448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.007485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.008169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.024564 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] HTTP exception thrown: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Request method failure captured: Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 HTTP/1.1 Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrfLeDs0YL0BnbM5EotfCr5iI8_vDun375_cszEgc4ui957KxXPLQy5zow7Mw244spOHbzeumdoLBKzZ6UmFdV516OR-bkvT0xWTgqkx1TNhDbUR9BqX5ssWgqCa_DGRPGkn-yJ2Vh5I6VsfaveJuQnEUQFevsw7KKWUonMn84Jo_k Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:46.026722 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96e2b5a124bf48fd82e48ed79aa4eeed"}]}] Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b158078d039a4979a9c0cf2be26c4b14 Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. Jun 24 04:22:46.035361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'f8df66c5-d6b4-4482-a7cd-7ddccb4c0675'} Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:46.036287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. Jun 24 04:22:46.037689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:46.039021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Returning 404 to user: Instance f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:46.039021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-312ccce4-f7dc-4ae3-aa7e-f762a403edf8 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675" status: 404 len: 111 microversion: 2.1 time: 0.034848 Jun 24 04:22:46.044579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a0777e8c-1278-40a8-b588-84ab8308d128 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '.version_select at 0x7fdfed5c4940>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:46.049753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 416/860] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:45 2022] GET /compute/v2.1/servers/f8df66c5-d6b4-4482-a7cd-7ddccb4c0675 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:46.120339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a0777e8c-1278-40a8-b588-84ab8308d128 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808044917" status: 202 len: 0 microversion: 2.1 time: 0.079859 Jun 24 04:22:46.124610 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 445/861] 10.222.0.16 () {58 vars in 1217 bytes} [Fri Jun 24 04:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808044917 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:22:46.448212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:46.448904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:46.460199 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.461002 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.462010 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.462612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.721776 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:46.722608 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:46.734685 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.735417 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.736378 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.739335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.794234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:46.809816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d88e94d9-d77c-4fce-b485-3950fca42a8c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.368198 Jun 24 04:22:46.810794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 417/862] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:46 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:46.951746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-26684df0-ebcd-4c46-aafc-dc6c49f8feec req-e9fe5808-48c9-4d1c-8492-524a2064a182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b70b01-cc71-40ad-a0dc-efe093913399", "tag": "40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:46.967620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-26684df0-ebcd-4c46-aafc-dc6c49f8feec req-e9fe5808-48c9-4d1c-8492-524a2064a182 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:46.969700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-26684df0-ebcd-4c46-aafc-dc6c49f8feec req-e9fe5808-48c9-4d1c-8492-524a2064a182 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:46.994235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-26684df0-ebcd-4c46-aafc-dc6c49f8feec req-e9fe5808-48c9-4d1c-8492-524a2064a182 service nova] Creating event network-changed:40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6 for instance 87b70b01-cc71-40ad-a0dc-efe093913399 on hv-cinder-84684 Jun 24 04:22:47.000906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-26684df0-ebcd-4c46-aafc-dc6c49f8feec req-e9fe5808-48c9-4d1c-8492-524a2064a182 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054319 Jun 24 04:22:47.002109 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 418/863] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:47.368490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:47.379958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-444b6ad2-ebe0-4fba-bee8-e7b60c3604b8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.662705 Jun 24 04:22:47.390466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 446/864] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:46 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:47.834704 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:47.835416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:47.843378 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:47.843960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:47.844825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:47.845460 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:48.005180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:48.016211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ad753776-9b78-4f50-96bc-dcf615008f3d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.186795 Jun 24 04:22:48.017235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 419/865] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:47 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:48.128297 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-1ed63c04-4401-4103-babc-e19b8f62fa32 req-6914b28b-ee84-4729-a92e-5bd5974dfcff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca634131-d896-451a-8213-b55471341fa6", "name": "network-vif-plugged", "status": "completed", "tag": "04c693b8-b0c5-4480-a278-08e6a78747c0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:48.138323 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:48.138919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:48.144044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1ed63c04-4401-4103-babc-e19b8f62fa32 req-6914b28b-ee84-4729-a92e-5bd5974dfcff service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:48.144488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-1ed63c04-4401-4103-babc-e19b8f62fa32 req-6914b28b-ee84-4729-a92e-5bd5974dfcff service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:48.172417 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-1ed63c04-4401-4103-babc-e19b8f62fa32 req-6914b28b-ee84-4729-a92e-5bd5974dfcff service nova] Creating event network-vif-plugged:04c693b8-b0c5-4480-a278-08e6a78747c0 for instance ca634131-d896-451a-8213-b55471341fa6 on hv-cinder-84684 Jun 24 04:22:48.177996 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-1ed63c04-4401-4103-babc-e19b8f62fa32 req-6914b28b-ee84-4729-a92e-5bd5974dfcff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054275 Jun 24 04:22:48.179197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 447/866] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:48.403639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:48.403639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:48.408405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:48.409088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:48.409861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:48.410428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:48.413616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:48.564212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:48.572516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4ee8033d-0be9-46ac-a250-fcd5c672fd03 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.177218 Jun 24 04:22:48.573969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 420/867] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:48 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:49.040575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:49.041368 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:49.048595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:49.049043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:49.049797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:49.050225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:49.207202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:49.214785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c4705dc0-01d4-430d-94cf-f573e8ae35d7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.179192 Jun 24 04:22:49.215351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 448/868] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:49 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:49.591400 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:49.592097 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:49.599947 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:49.600453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:49.601152 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:49.601585 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:49.797512 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:49.805506 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-cd2f9e34-ae7d-428a-b0be-41f936c77c20 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.218250 Jun 24 04:22:49.806076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 421/869] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:49 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:50.232357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:50.232910 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:50.240514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.240982 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.241967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.242423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.393364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:50.401159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e4e9611-790c-4d9c-b9bc-b749098e0687 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1363 microversion: 2.1 time: 0.172905 Jun 24 04:22:50.401725 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 449/870] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:50 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:50.567163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:50.567651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:50.573633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.574220 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.575000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.575431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.602076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:50.821901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:50.822851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:50.831983 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.832431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.833413 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.833848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.902784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3bb143d8-1dfd-4338-8a80-fadb909673b6 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 204 len: 0 microversion: 2.1 time: 0.338860 Jun 24 04:22:50.904027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 422/871] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:50 2022] DELETE /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:50.913672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:50.914589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:50.922207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.923046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:50.923898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:50.926855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:51.021225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:51.033316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-91f6666e-2d21-4091-aa64-492fee43d0a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.215104 Jun 24 04:22:51.045101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 450/872] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:50 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:51.102279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:51.110416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-096d33da-4da0-443a-9ed9-d0d8445f96d0 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1507 microversion: 2.1 time: 0.201586 Jun 24 04:22:51.110990 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 423/873] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:50 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:51.418716 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:51.419325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:51.426703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:51.427144 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:51.427893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:51.428322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:51.732539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:51.741607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-89867ec9-ff6c-431a-86c8-9d757feed680 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1549 microversion: 2.1 time: 0.326645 Jun 24 04:22:51.742857 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 451/874] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:51 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1549 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:51.759961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:51.760521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:51.768921 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:51.769441 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:51.770286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:51.770863 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:51.850816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bad40234-57f9-4daf-a54c-eec356c9fd0b tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095263 Jun 24 04:22:51.851488 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 424/875] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:22:51 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:22:52.049724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:52.050704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:52.057973 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:52.062026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:52.062026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:52.062026 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:52.102440 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-43d7b51d-f83b-4356-9c52-6727725865b2 req-5825c2e5-7464-4a33-86a0-8255516bd7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b70b01-cc71-40ad-a0dc-efe093913399", "name": "network-vif-plugged", "status": "completed", "tag": "40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:52.120733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-43d7b51d-f83b-4356-9c52-6727725865b2 req-5825c2e5-7464-4a33-86a0-8255516bd7bd service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:52.121364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-43d7b51d-f83b-4356-9c52-6727725865b2 req-5825c2e5-7464-4a33-86a0-8255516bd7bd service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:52.138940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-43d7b51d-f83b-4356-9c52-6727725865b2 req-5825c2e5-7464-4a33-86a0-8255516bd7bd service nova] Creating event network-vif-plugged:40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6 for instance 87b70b01-cc71-40ad-a0dc-efe093913399 on hv-cinder-84684 Jun 24 04:22:52.144328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-43d7b51d-f83b-4356-9c52-6727725865b2 req-5825c2e5-7464-4a33-86a0-8255516bd7bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048102 Jun 24 04:22:52.145650 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 425/876] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:52.151915 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:52.152892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:52.159589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:52.160294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:52.161261 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:52.161863 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:52.454085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:52.463650 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-78f60a0f-a152-463e-b0c0-3ebd30bbe2a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.417966 Jun 24 04:22:52.473215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:52.474812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 452/877] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:52 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:52.476888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6efd5da6-4c77-4a08-9d01-2f22cff859fb tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1507 microversion: 2.1 time: 0.329749 Jun 24 04:22:52.477750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 426/878] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:52 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:53.484526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:53.486021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:53.495763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:53.496377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:53.498306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.499691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.502068 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.502878 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.508690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.509134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.509936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.511798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.673722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:53.681962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ce3e875a-9606-400a-8874-ca6fdc3dee89 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.203948 Jun 24 04:22:53.682782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 453/879] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:53 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:53.688720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-da61e40e-e3f9-484f-941f-8b89b87c10cf req-4e5faea4-06d8-4599-8a12-3e323a716566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca634131-d896-451a-8213-b55471341fa6", "tag": "04c693b8-b0c5-4480-a278-08e6a78747c0"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:53.699303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-da61e40e-e3f9-484f-941f-8b89b87c10cf req-4e5faea4-06d8-4599-8a12-3e323a716566 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.699887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-da61e40e-e3f9-484f-941f-8b89b87c10cf req-4e5faea4-06d8-4599-8a12-3e323a716566 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.714528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-da61e40e-e3f9-484f-941f-8b89b87c10cf req-4e5faea4-06d8-4599-8a12-3e323a716566 service nova] Creating event network-changed:04c693b8-b0c5-4480-a278-08e6a78747c0 for instance ca634131-d896-451a-8213-b55471341fa6 on hv-cinder-84684 Jun 24 04:22:53.720929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-da61e40e-e3f9-484f-941f-8b89b87c10cf req-4e5faea4-06d8-4599-8a12-3e323a716566 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Jun 24 04:22:53.721757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 454/880] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:53.807056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:53.808579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:53.814993 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:53.820173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.820723 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.822351 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:53.822937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:53.828095 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d05625b5-c89d-4dfd-a56e-0bad60eb2036 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1507 microversion: 2.1 time: 0.334963 Jun 24 04:22:53.839338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 427/881] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:53 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:53.856903 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:53.861589 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lazy-loading 'flavor' on Instance uuid 29140f43-38c3-47c1-84f2-0181cb18e153 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:54.173200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c45455e-72d2-4664-a4ae-22b1dfec71e0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "POST /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153/action" status: 202 len: 0 microversion: 2.1 time: 0.372361 Jun 24 04:22:54.173795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 455/882] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:22:53 2022] POST /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 04:22:54.182419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:54.183155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:54.190015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.190500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:54.191257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.191685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:54.509140 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:54.516965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f30c08b7-ed5c-4fb5-b296-fa162dc76bc0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.338588 Jun 24 04:22:54.518702 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 428/883] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:54 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:54.703531 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:54.704349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:54.711712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.713161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:54.714053 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.714636 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:54.908480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:54.921772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-00446388-823c-4e9c-8392-4c7a6f4a92a4 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1367 microversion: 2.1 time: 0.222052 Jun 24 04:22:54.921772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 456/884] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:54 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:54.925120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:54.925728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:54.932249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.932765 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:54.933536 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:54.933964 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.002455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:55.010307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a28a5f6d-1995-4f2f-aee8-68be82eaae75 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 200 len: 1292 microversion: 2.1 time: 0.090584 Jun 24 04:22:55.010905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 457/885] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:54 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:55.019092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:55.019595 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:55.025954 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.026424 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.027191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.027628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.052335 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2debb98a-1775-4436-9fbb-02a2933566ad tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/ips" status: 200 len: 151 microversion: 2.20 time: 0.248054 Jun 24 04:22:55.052897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 429/886] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jun 24 04:22:54 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/ips => generated 151 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:22:55.536573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:55.537181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:55.543222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.543663 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.546307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.546307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.697249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:55.705949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-38bbbded-e3ac-4694-8756-2dbd6fb7a62e tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.173369 Jun 24 04:22:55.707059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 458/887] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:55 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:55.752931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-2b40f373-c78d-4856-93cd-1bdf5215b4a2 req-175b30b5-93c3-48f4-b6b9-b22d349914eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734155da-ee09-4da7-aa56-2c506b7ed2cd", "name": "network-vif-deleted", "tag": "15680038-79e1-44d0-bf98-1d22ed996825"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:55.761633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-2b40f373-c78d-4856-93cd-1bdf5215b4a2 req-175b30b5-93c3-48f4-b6b9-b22d349914eb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.762078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-2b40f373-c78d-4856-93cd-1bdf5215b4a2 req-175b30b5-93c3-48f4-b6b9-b22d349914eb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.773545 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-2b40f373-c78d-4856-93cd-1bdf5215b4a2 req-175b30b5-93c3-48f4-b6b9-b22d349914eb service nova] Creating event network-vif-deleted:15680038-79e1-44d0-bf98-1d22ed996825 for instance 734155da-ee09-4da7-aa56-2c506b7ed2cd on hv-cinder-84684 Jun 24 04:22:55.778829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-2b40f373-c78d-4856-93cd-1bdf5215b4a2 req-175b30b5-93c3-48f4-b6b9-b22d349914eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Jun 24 04:22:55.781041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 430/888] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:55.935702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:55.936941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:55.943295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.943749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:55.944517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:55.944953 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.027551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:56.028230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: 734155da-ee09-4da7-aa56-2c506b7ed2cd] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:56.038864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.039680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.040065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.040490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.055711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] HTTP exception thrown: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Request method failure captured: Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd HTTP/1.1 Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrfLeDs0YL0BnbM5EotfCr5iI8_vDun375_cszEgc4ui957KxXPLQy5zow7Mw244spOHbzeumdoLBKzZ6UmFdV516OR-bkvT0xWTgqkx1TNhDbUR9BqX5ssWgqCa_DGRPGkn-yJ2Vh5I6VsfaveJuQnEUQFevsw7KKWUonMn84Jo_k Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:22:56.057510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96e2b5a124bf48fd82e48ed79aa4eeed"}]}] Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: b158078d039a4979a9c0cf2be26c4b14 Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. Jun 24 04:22:56.058940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '734155da-ee09-4da7-aa56-2c506b7ed2cd'} Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:22:56.059841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. Jun 24 04:22:56.062245 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:22:56.063868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Returning 404 to user: Instance 734155da-ee09-4da7-aa56-2c506b7ed2cd could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:22:56.063868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0d7618d2-ac13-4189-ac3a-3f5567f1db69 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd" status: 404 len: 111 microversion: 2.1 time: 0.035798 Jun 24 04:22:56.069861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 431/889] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:56 2022] GET /compute/v2.1/servers/734155da-ee09-4da7-aa56-2c506b7ed2cd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:22:56.074694 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:56.075252 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:56.081849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.082295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.083088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.083518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.110434 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:56.116431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:22:56.118113 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f09bdf4-cc17-4ab4-b4cd-41af82c46790 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1558 microversion: 2.1 time: 0.186323 Jun 24 04:22:56.120112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 459/890] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:55 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:56.134698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:56.135352 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:56.141361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.141810 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.142651 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.143086 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.225212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-80827069-6445-4c1e-98e1-94a5bfa690aa tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094325 Jun 24 04:22:56.225813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 460/891] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jun 24 04:22:56 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:22:56.493932 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-711abf71-651a-4c7b-ac7a-8e897201e81d tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 204 len: 0 microversion: 2.1 time: 0.422668 Jun 24 04:22:56.494703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 432/892] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:22:56 2022] DELETE /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:56.502892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:56.503506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:56.509615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.510061 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.510861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.511297 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.725341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:56.726133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:56.732338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.732781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.736265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:56.736788 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:56.812305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:56.820089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ee8cea1c-9a10-4424-af75-64da2d18df86 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.321103 Jun 24 04:22:56.820662 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 461/893] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:56 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:56.896207 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:56.904312 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c180f124-cae7-4d34-ac64-bd6e428227cf tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.183980 Jun 24 04:22:56.905000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 433/894] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:56 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:57.224008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:57.224916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:57.231071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.231519 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.232287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.232721 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.256697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lazy-loading 'flavor' on Instance uuid 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:22:57.485675 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-94d2bc5a-f5b2-4e79-adf7-55d8e97bf6cd req-28eac047-a672-414b-a169-92b63d675218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b70b01-cc71-40ad-a0dc-efe093913399", "tag": "40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:22:57.494082 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-94d2bc5a-f5b2-4e79-adf7-55d8e97bf6cd req-28eac047-a672-414b-a169-92b63d675218 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.494658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-94d2bc5a-f5b2-4e79-adf7-55d8e97bf6cd req-28eac047-a672-414b-a169-92b63d675218 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.506317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-94d2bc5a-f5b2-4e79-adf7-55d8e97bf6cd req-28eac047-a672-414b-a169-92b63d675218 service nova] Creating event network-changed:40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6 for instance 87b70b01-cc71-40ad-a0dc-efe093913399 on hv-cinder-84684 Jun 24 04:22:57.511383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-94d2bc5a-f5b2-4e79-adf7-55d8e97bf6cd req-28eac047-a672-414b-a169-92b63d675218 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182979 Jun 24 04:22:57.511977 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 434/895] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:22:57.834814 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3be7618d-1fd9-4fa9-a90d-3196a8bedfbb tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/action" status: 202 len: 0 microversion: 2.20 time: 0.614586 Jun 24 04:22:57.836021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 462/896] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jun 24 04:22:57 2022] POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:22:57.841758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:57.842852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:57.851377 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:57.852071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:57.857328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.857767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.858622 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.859054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.878335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.879371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:57.880204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:57.880635 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:58.033707 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:58.036140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:58.042155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4c674f43-56ba-4bc2-878d-1bb606bf1559 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.207591 Jun 24 04:22:58.043350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 435/897] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:57 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:22:58.050350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:58.051005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:58.056241 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:58.057267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:58.057783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:58.058201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:58.058595 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:58.059036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:58.059551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a35240c4-68dc-4859-97ae-967f127075f6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.212508 Jun 24 04:22:58.060171 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 463/898] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:57 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:22:58.215246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:58.218003 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:22:58.231034 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e9958f6a-9f50-4859-b15d-9f6bf7b0290a tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.186380 Jun 24 04:22:58.231931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 436/899] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:58 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:59.059748 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:59.060583 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:59.068041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.068488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.069900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.070341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.080115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:59.081121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:59.089759 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.090476 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.091569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.093037 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.224736 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:59.236066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:59.237602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:59.241009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3ece23a8-bc5a-4a7f-9325-7e37a7d85428 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.166498 Jun 24 04:22:59.241586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 437/900] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:22:59 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:22:59.251878 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:22:59.252547 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:22:59.259039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.259493 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.260276 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:22:59.260716 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:22:59.290004 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:59.300116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bd0710c1-9ff4-4216-8518-5513054e8152 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.244394 Jun 24 04:22:59.301559 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 464/901] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:59 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:22:59.425213 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:22:59.436770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d8e599dd-0989-4b06-a16d-4afe4210a44d tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.189452 Jun 24 04:22:59.440774 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 438/902] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:22:59 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:00.264464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:00.265076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:00.280945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.282034 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.287633 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.290406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.319036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:00.320881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:00.333885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.334404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.335139 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.335573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.523348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:00.533398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:00.536324 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:00.536776 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4af44997-413d-403a-8b86-4fe8caa54d62 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.276248 Jun 24 04:23:00.537586 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 465/903] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:00 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:00.556171 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:00.556784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:00.564658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.565383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.566158 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:00.566618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:00.675273 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:00.691397 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fc97f7af-25dd-442f-a185-148be448ea0a tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1522 microversion: 2.1 time: 0.377000 Jun 24 04:23:00.701071 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 439/904] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:00 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:00.808038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:00.821102 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f8ecb574-3315-4686-a407-e7511ed4da48 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.269177 Jun 24 04:23:00.855495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 466/905] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:00 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:01.130454 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-d3001277-4076-451f-bcd4-b00117ff1776 req-0407baa7-85cc-45c1-a27a-444bf94d6970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab22e349-8bc5-4678-979e-0db7dfcfdb29", "name": "network-vif-deleted", "tag": "628c6256-3f93-415e-8d57-183e79f02abb"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:01.142169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-d3001277-4076-451f-bcd4-b00117ff1776 req-0407baa7-85cc-45c1-a27a-444bf94d6970 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.142898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-d3001277-4076-451f-bcd4-b00117ff1776 req-0407baa7-85cc-45c1-a27a-444bf94d6970 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.155107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-d3001277-4076-451f-bcd4-b00117ff1776 req-0407baa7-85cc-45c1-a27a-444bf94d6970 service nova] Creating event network-vif-deleted:628c6256-3f93-415e-8d57-183e79f02abb for instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 on hv-cinder-84684 Jun 24 04:23:01.160141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-d3001277-4076-451f-bcd4-b00117ff1776 req-0407baa7-85cc-45c1-a27a-444bf94d6970 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098955 Jun 24 04:23:01.164490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 440/906] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:01.556836 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:01.558063 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:01.565707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.566409 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.567376 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.567957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.710187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:01.711501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:01.722920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.723368 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.725943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.726409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.762447 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.763141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.763817 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lazy-loading 'fault' on Instance uuid ab22e349-8bc5-4678-979e-0db7dfcfdb29 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:23:01.773010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:01.798423 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:01.803925 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:01.805546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9a007b8b-49b0-43f5-abe9-e1149454f41b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.252586 Jun 24 04:23:01.818746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 467/907] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:01 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:01.824619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158078d039a4979a9c0cf2be26c4b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e2b5a124bf48fd82e48ed79aa4eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:01.836626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d75d634f-3cf3-4588-9dc7-15de18a031bc tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 200 len: 1311 microversion: 2.1 time: 0.130974 Jun 24 04:23:01.843234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 441/908] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:01 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:01.872667 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:01.873294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:01.880278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.880728 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.881498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:01.881981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:01.886972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:02.072226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:02.083767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e8d3e576-fcdd-46b8-aff6-4e1be6107a21 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.215254 Jun 24 04:23:02.085703 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 468/909] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:01 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:02.825145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:02.825756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:02.833496 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:02.833949 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:02.834826 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:02.835257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:02.857099 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:02.857716 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] [instance: ab22e349-8bc5-4678-979e-0db7dfcfdb29] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:02.875173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:02.875647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:02.876659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:02.877252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] HTTP exception thrown: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Request method failure captured: Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 HTTP/1.1 Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrfLeDs0YL0BnbM5EotfCr5iI8_vDun375_cszEgc4ui957KxXPLQy5zow7Mw244spOHbzeumdoLBKzZ6UmFdV516OR-bkvT0xWTgqkx1TNhDbUR9BqX5ssWgqCa_DGRPGkn-yJ2Vh5I6VsfaveJuQnEUQFevsw7KKWUonMn84Jo_k Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:23:02.901108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96e2b5a124bf48fd82e48ed79aa4eeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96e2b5a124bf48fd82e48ed79aa4eeed"}]}] Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 96e2b5a124bf48fd82e48ed79aa4eeed Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1957770559 Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: b158078d039a4979a9c0cf2be26c4b14 Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1957770559-project Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. Jun 24 04:23:02.902761 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ab22e349-8bc5-4678-979e-0db7dfcfdb29'} Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:23:02.903543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. Jun 24 04:23:02.906050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:02.907691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] Returning 404 to user: Instance ab22e349-8bc5-4678-979e-0db7dfcfdb29 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:23:02.907691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-328a2207-60cc-4fad-b4a6-9323be861857 tempest-ServerRescueNegativeTestJSON-1957770559 tempest-ServerRescueNegativeTestJSON-1957770559-project] 10.222.0.16 "GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29" status: 404 len: 111 microversion: 2.1 time: 0.051380 Jun 24 04:23:02.907691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 469/910] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:02 2022] GET /compute/v2.1/servers/ab22e349-8bc5-4678-979e-0db7dfcfdb29 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:23:03.031085 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:03.047638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:03.049384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:03.050866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-58b47b87-5270-43c3-be92-6dc1b4276b10 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.229596 Jun 24 04:23:03.051916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 442/911] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:02 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:03.104727 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:03.105428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:03.114101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:03.114902 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:03.115919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:03.116598 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:03.637288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:03.649177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0f7c832f-b6a6-4666-98b2-269a5545de11 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.550339 Jun 24 04:23:03.661112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 470/912] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:03 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:04.070099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:04.070873 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:04.085308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:04.085972 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:04.086936 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:04.087672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:04.278209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:04.287710 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:04.291427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:04.292634 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5c9c03ea-fb49-4f3c-b797-0f3879268dfa tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.227610 Jun 24 04:23:04.298066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 443/913] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:04 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:04.668531 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:04.669294 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:04.684449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:04.685162 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:04.689900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:04.690577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:05.010994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:05.023353 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2b645abf-4579-41df-b555-cb2f88449793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.356838 Jun 24 04:23:05.025701 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 471/914] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:04 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:05.312347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:05.313126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:05.324881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:05.327986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:05.328251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:05.328790 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:05.645955 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:05.662043 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:05.663818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:05.675855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-289f0185-dbc1-4ea2-a70a-4b606140927f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.357646 Jun 24 04:23:05.675855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 444/915] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:05 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:06.041566 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:06.045012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:06.053606 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:06.054253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:06.055255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:06.055847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:06.365173 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:06.376531 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ffaf4cbf-b476-4774-976e-d00075c0fb52 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.339150 Jun 24 04:23:06.395952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 472/916] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:06 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:06.684099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:06.685996 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:06.700194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:06.703355 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:06.704857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:06.705653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:07.396897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:07.397506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:07.405993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:07.412249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:07.412249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:07.412249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:07.432185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:07.471991 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:07.479647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:07.479647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b671aee2-193d-4768-abc0-c92d626bdccd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.796409 Jun 24 04:23:07.480814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 445/917] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:06 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:07.810467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:07.850082 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f70fa275-82e8-40c3-9656-54c2debb983c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.433747 Jun 24 04:23:07.851325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 473/918] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:07 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:08.496978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:08.497578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:08.504601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:08.505470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:08.516940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:08.516940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:08.823520 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:08.834885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:08.837974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:08.839679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d26c9d2d-a32d-4f53-8dbd-605441f9b126 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.346699 Jun 24 04:23:08.851601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 446/919] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:08 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:08.868398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:08.869011 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:08.872897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:08.877469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:08.877912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:08.879127 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:08.879639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.060207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:09.071116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8b71464a-77dc-4f25-8a1d-e9e044206758 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1570 microversion: 2.1 time: 0.206904 Jun 24 04:23:09.071764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 474/920] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:08 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1570 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:09.092281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:09.093768 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:09.100780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.101239 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.102019 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.102820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.589268 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b445e44c-444c-416c-9435-bef7eed52b69 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "POST /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153/action" status: 202 len: 0 microversion: 2.1 time: 0.500904 Jun 24 04:23:09.595864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 447/921] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jun 24 04:23:09 2022] POST /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:23:09.599245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:09.600048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:09.621200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.621726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.624665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.625116 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.858869 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:09.859482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:09.878521 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.878908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.879708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:09.880147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:09.928268 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:09.941740 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35097481-d50a-4d7f-80c1-c8d1caa68b88 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1518 microversion: 2.1 time: 0.346033 Jun 24 04:23:09.947369 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 475/922] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:09 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1518 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:10.132016 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:10.142557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:10.144314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:10.145718 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d38bd421-d950-4691-8a47-78b2b23a92e6 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.291190 Jun 24 04:23:10.157022 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 448/923] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:09 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:10.343347 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-15f2ec44-94e6-4075-a2d9-4fcc1d068c01 req-277bf4d5-a307-407f-a8a7-846b3c056d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "name": "network-vif-unplugged", "status": "completed", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:10.353886 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-15f2ec44-94e6-4075-a2d9-4fcc1d068c01 req-277bf4d5-a307-407f-a8a7-846b3c056d3f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:10.356243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-15f2ec44-94e6-4075-a2d9-4fcc1d068c01 req-277bf4d5-a307-407f-a8a7-846b3c056d3f service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:10.371187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.compute.server_external_events [req-15f2ec44-94e6-4075-a2d9-4fcc1d068c01 req-277bf4d5-a307-407f-a8a7-846b3c056d3f service nova] Unable to find a host for instance 29140f43-38c3-47c1-84f2-0181cb18e153. Dropping event network-vif-unplugged {{(pid=118331) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 04:23:10.372295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-15f2ec44-94e6-4075-a2d9-4fcc1d068c01 req-277bf4d5-a307-407f-a8a7-846b3c056d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.118512 Jun 24 04:23:10.374357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 476/924] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 120 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 04:23:10.961114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:10.961752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:10.970480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:10.972875 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:10.974900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:10.979377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:11.215807 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:11.225734 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4b136b9f-1b41-489b-8f95-612bef1651e7 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1518 microversion: 2.1 time: 0.269000 Jun 24 04:23:11.230648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 449/925] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:10 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:11.238925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:11.245591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:11.246232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:11.252610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:11.253375 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:11.254343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:11.254965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:11.381999 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-93c9288f-6290-4819-b114-3cada77708e9 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Action: 'create', calling method: .version_select at 0x7fdfed3770d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1059671374"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:11.431024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:11.441063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:11.444109 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:11.445659 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9c5e4658-84d2-4189-b229-e1ed6f7e6d86 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1740 microversion: 2.20 time: 0.213796 Jun 24 04:23:11.446753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 450/926] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:11 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:12.252191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-93c9288f-6290-4819-b114-3cada77708e9 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.111573 Jun 24 04:23:12.253050 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 477/927] 10.222.0.16 () {60 vars in 1154 bytes} [Fri Jun 24 04:23:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1115 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 24 04:23:12.259717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:12.260551 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:12.272449 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:12.272935 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:12.274147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:12.274760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:12.383888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-111b6a67-ad32-4a58-8e89-0677e8cd5eb4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Action: 'create', calling method: .version_select at 0x7fdfed10c1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-716432859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHctScIpfJkNuIPCRfazAehNeZ/5Ty1DotSHLecS6VrjXnHP7+4O4T/YKtXcXGp/T0EgG9oOmwu7oSTPPS0+tcHc7TzxypkpFsCg7vwVtTjQbZuML/u9dPWqKYE5TBS+RA=="}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:12.412201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-111b6a67-ad32-4a58-8e89-0677e8cd5eb4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:23:12.418431 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.quota [None req-111b6a67-ad32-4a58-8e89-0677e8cd5eb4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for user d1cee676e3dc47e18e94de7e20b59455 and project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'key_pairs'} {{(pid=118330) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:23:12.479872 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:12.491211 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fe191d63-10fc-447c-b0d5-390d2d2eeff0 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1520 microversion: 2.1 time: 0.235787 Jun 24 04:23:12.492345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 478/928] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:12 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:12.497741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-63df0b9b-cb3e-44f6-8e59-ab5f3e055cb0 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed3c8550>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:12.534533 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-111b6a67-ad32-4a58-8e89-0677e8cd5eb4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.322909 Jun 24 04:23:12.535508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 451/929] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Jun 24 04:23:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:12.547271 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:12.550969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:12.561029 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:12.561963 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:12.566275 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:12.566275 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:12.575668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-63df0b9b-cb3e-44f6-8e59-ab5f3e055cb0 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 200 len: 345 microversion: 2.1 time: 0.081926 Jun 24 04:23:12.576779 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 479/930] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:23:12 2022] GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:12.724842 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:12.743437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:12.744933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:12.746111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a7e04616-978b-45c5-8e18-1859e2c2d177 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1740 microversion: 2.20 time: 0.209486 Jun 24 04:23:12.746703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 452/931] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:12 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:13.509665 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:13.510447 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:13.517618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:13.518094 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:13.519093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:13.519698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:13.590580 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e8f6cdca-801d-46e8-8a2d-3ec9749c18d4 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed10c820>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:13.688036 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e8f6cdca-801d-46e8-8a2d-3ec9749c18d4 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 200 len: 346 microversion: 2.1 time: 0.103079 Jun 24 04:23:13.688803 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 453/932] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:23:13 2022] GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:13.700068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fdceb182-0ee1-4493-bac9-b67b69b5daf1 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Action: 'create', calling method: .version_select at 0x7fdfed2e4160>, body: {"snapshot": {"volume_id": "b92d9ed2-9bd0-4e0c-bddb-9f670891160a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-519686070"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:13.702072 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:13.715385 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c31d39ad-51cc-4e35-9946-092112579b40 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.210222 Jun 24 04:23:13.717226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 480/933] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:13 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:13.766129 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:13.767184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:13.775087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:13.775916 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:13.776846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:13.777987 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:13.999631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:14.015734 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:14.018157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:14.021715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3e1a5c62-4c18-46e2-906b-6b7dad054afc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.259820 Jun 24 04:23:14.022807 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 481/934] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:13 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:14.216134 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-d413d626-054f-42ab-b921-1096cefbc497 req-e05e9927-c87b-4302-b320-142a1a8342fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "name": "network-vif-plugged", "status": "completed", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:14.247823 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d413d626-054f-42ab-b921-1096cefbc497 req-e05e9927-c87b-4302-b320-142a1a8342fe service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:14.248772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d413d626-054f-42ab-b921-1096cefbc497 req-e05e9927-c87b-4302-b320-142a1a8342fe service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:14.249596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fdceb182-0ee1-4493-bac9-b67b69b5daf1 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.553195 Jun 24 04:23:14.250467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 454/935] 10.222.0.16 () {60 vars in 1161 bytes} [Fri Jun 24 04:23:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:14.262677 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-83db18f7-e577-4bae-8d84-9a90ab8c5daa tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed0dc280>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:14.283225 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-d413d626-054f-42ab-b921-1096cefbc497 req-e05e9927-c87b-4302-b320-142a1a8342fe service nova] Creating event network-vif-plugged:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:23:14.289502 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-d413d626-054f-42ab-b921-1096cefbc497 req-e05e9927-c87b-4302-b320-142a1a8342fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081698 Jun 24 04:23:14.291581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 482/936] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:14.324916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-83db18f7-e577-4bae-8d84-9a90ab8c5daa tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.068121 Jun 24 04:23:14.325486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 455/937] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:14 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:14.340457 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-221e2034-2444-465d-8c38-f8a128181d03 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed220820>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:14.411430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-221e2034-2444-465d-8c38-f8a128181d03 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.078274 Jun 24 04:23:14.413460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 483/938] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jun 24 04:23:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:14.424009 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-696ad03e-bcc4-469d-92d6-95391bb8cd56 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed0cc9d0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:14.488058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-696ad03e-bcc4-469d-92d6-95391bb8cd56 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.069007 Jun 24 04:23:14.489141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 456/939] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:14 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:14.734318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:14.737705 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:14.748796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:14.748796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:14.748796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:14.748796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:14.965437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:14.976578 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c9765c7c-2824-4853-ad19-e488c390ab03 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.246885 Jun 24 04:23:14.977425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 484/940] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:14 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:15.041846 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:15.043191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:15.051568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:15.052302 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:15.053391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:15.054013 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:15.223135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:15.225823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:15.234578 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:15.236358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:15.237549 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7c20776c-424d-4122-8d61-19a3c5f02583 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.200409 Jun 24 04:23:15.238104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 457/941] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:15 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:15.500207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7d88113d-255f-4ee2-ba22-c0be09224eb9 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed523940>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:15.540711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7d88113d-255f-4ee2-ba22-c0be09224eb9 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.044570 Jun 24 04:23:15.541726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 485/942] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:15 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:15.994497 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:15.997754 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:16.008275 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:16.009199 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:16.009988 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:16.010934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:16.239150 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:16.247486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-686be117-a4f0-4d12-b9a4-5d0639596352 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.257244 Jun 24 04:23:16.248898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 458/943] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:15 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:16.262160 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:16.263401 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:16.272190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:16.272651 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:16.273439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:16.274151 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:16.502616 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:16.514499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:16.516373 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:16.517994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d6e9e5cc-55a5-4165-982f-eab21a374825 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.266131 Jun 24 04:23:16.531691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 486/944] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:16 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:16.552281 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6526be57-fe31-42e7-9bf5-8441636a0427 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed0e9700>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:16.597278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6526be57-fe31-42e7-9bf5-8441636a0427 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.048463 Jun 24 04:23:16.598060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 459/945] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:16 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:17.266345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:17.267095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:17.278350 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:17.279585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:17.280710 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:17.282817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:17.439647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:17.447376 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fb163e24-7495-4e53-a0c0-cf0659d383d1 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.186122 Jun 24 04:23:17.447932 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 487/946] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:17 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:17.538167 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:17.538835 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:17.545240 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:17.545373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:17.546132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:17.546611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:17.609184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b26f4196-cfff-4a3d-91f3-ac716cd7f59c tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed580280>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:17.681678 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b26f4196-cfff-4a3d-91f3-ac716cd7f59c tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.076393 Jun 24 04:23:17.682248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 488/947] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:17 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:17.709069 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:17.718225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:17.719777 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:17.720952 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ad836c73-aaac-479f-98f3-fff740e41fde tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.187218 Jun 24 04:23:17.721516 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 460/948] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:17 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:18.484656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:18.484656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:18.489788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:18.490233 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:18.491071 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:18.491510 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:18.663542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:18.680755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-902a55c1-dd75-4b1c-9b6a-c100c517d793 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.218746 Jun 24 04:23:18.692631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 489/949] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:18 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:18.696786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e476ab12-c790-4ffb-8f17-0432bb650506 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed2f44c0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:18.738350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e476ab12-c790-4ffb-8f17-0432bb650506 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 287 microversion: 2.1 time: 0.046463 Jun 24 04:23:18.739944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:18.740749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:18.744866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 461/950] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:18 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:18.751247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:18.751700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:18.752495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:18.752930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:18.754642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ce29525b-b5ca-427e-9766-f46655eaeac4 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed10c700>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:18.931063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ce29525b-b5ca-427e-9766-f46655eaeac4 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 202 len: 0 microversion: 2.1 time: 0.184576 Jun 24 04:23:18.932272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 462/951] 10.222.0.16 () {58 vars in 1253 bytes} [Fri Jun 24 04:23:18 2022] DELETE /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:23:18.943330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6409056a-27bc-4ba7-99c1-8dc4ad04a093 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed0878b0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:18.991874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:19.004701 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:19.004999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6409056a-27bc-4ba7-99c1-8dc4ad04a093 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 200 len: 286 microversion: 2.1 time: 0.065859 Jun 24 04:23:19.005623 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 463/952] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:18 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:19.007367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:19.009121 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5f95b66d-d410-4e24-aee6-d2a4205fdcb7 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.273568 Jun 24 04:23:19.009785 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 490/953] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:18 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:19.699645 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:19.700970 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:19.731976 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:19.733298 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:19.734285 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:19.734914 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:19.902127 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:19.914157 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5c73cfd1-aa25-4571-9b50-660eb7dc4df8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.219194 Jun 24 04:23:19.915149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 464/954] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:19 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:20.017620 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9d6be782-471c-4924-8330-b5fe3786e542 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed3883a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:20.031288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:20.032187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:20.045893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:20.046656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:20.047662 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:20.048309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:20.053877 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-9d6be782-471c-4924-8330-b5fe3786e542 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] HTTP exception thrown: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9d6be782-471c-4924-8330-b5fe3786e542 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Request method failure captured: Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d HTTP/1.1 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTwvc9KO07zO3lJg0FZzrHYNwGf-f1_KQXPSkyvHdi9V0s5nadcA-cgCwe1sOLISZDOlqVQEshpCGM23s0wIQv5a3qM1VczZia2iM4DqxJQO053IeiLmhbTQjgsyAyMbewvRoHaMA-UH-D74_GPt-ZcJbvSI2TCUG4AAQYz5SMquIC8 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:23:20.056288 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6031a2f5e18544b68d3caec584330e42"}]}] Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 2366a2600d2e4821a26c633ddad878e9 Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '63d2c0fe-0997-4b8e-9f5f-aa408905590d'} Jun 24 04:23:20.057873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. (HTTP 404) (Request-ID: req-93e76749-a23d-47b2-a48c-11412ca85727) Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.058904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:20.063150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 04:23:20.071398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9d6be782-471c-4924-8330-b5fe3786e542 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Returning 404 to user: Snapshot 63d2c0fe-0997-4b8e-9f5f-aa408905590d could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:23:20.074646 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9d6be782-471c-4924-8330-b5fe3786e542 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d" status: 404 len: 111 microversion: 2.1 time: 0.045775 Jun 24 04:23:20.076305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 491/955] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:23:20 2022] GET /compute/v2.1/os-snapshots/63d2c0fe-0997-4b8e-9f5f-aa408905590d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:23:20.081538 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2bafdc6f-a32d-4cf5-95c3-3d79e9443d88 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed3ac040>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:20.246309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:20.255559 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:20.257125 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:20.258308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-20075924-d378-4c48-80e5-553b0efba233 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.233504 Jun 24 04:23:20.259014 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 465/956] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:20 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:20.332861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2bafdc6f-a32d-4cf5-95c3-3d79e9443d88 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 202 len: 0 microversion: 2.1 time: 0.266926 Jun 24 04:23:20.333797 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 492/957] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:23:20 2022] DELETE /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:23:20.342700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-aec4c3d3-e8cf-4309-a739-a2a79ff77a4e tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed16a940>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:20.405286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-aec4c3d3-e8cf-4309-a739-a2a79ff77a4e tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 200 len: 345 microversion: 2.1 time: 0.067483 Jun 24 04:23:20.406179 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 466/958] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:23:20 2022] GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:20.934969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:20.935759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:20.946307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:20.946990 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:20.947825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:20.948251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:21.158796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:21.158796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:21.158796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-402788b7-939a-4cf5-8167-ee0ef0d4a9f9 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.185702 Jun 24 04:23:21.158796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 493/959] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:20 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:21.279125 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:21.279886 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:21.286631 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:21.287090 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:21.287881 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:21.288344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:21.418355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8de3a7f9-6834-4977-ba5a-aff82b30a0f2 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed2200d0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:21.428191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:21.438452 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:21.440292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:21.441467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c1f4e28c-6847-4511-bd8c-e58efda6c870 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.167311 Jun 24 04:23:21.442024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 467/960] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:21 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:21.447130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-8de3a7f9-6834-4977-ba5a-aff82b30a0f2 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] HTTP exception thrown: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8de3a7f9-6834-4977-ba5a-aff82b30a0f2 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Request method failure captured: Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a HTTP/1.1 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTwvc9KO07zO3lJg0FZzrHYNwGf-f1_KQXPSkyvHdi9V0s5nadcA-cgCwe1sOLISZDOlqVQEshpCGM23s0wIQv5a3qM1VczZia2iM4DqxJQO053IeiLmhbTQjgsyAyMbewvRoHaMA-UH-D74_GPt-ZcJbvSI2TCUG4AAQYz5SMquIC8 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:23:21.449577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6031a2f5e18544b68d3caec584330e42"}]}] Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 2366a2600d2e4821a26c633ddad878e9 Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'b92d9ed2-9bd0-4e0c-bddb-9f670891160a'} Jun 24 04:23:21.450994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. (HTTP 404) (Request-ID: req-85c38507-3494-4781-94f3-a66716d41d0a) Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.451817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:21.453122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 04:23:21.454546 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.455802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.457358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8de3a7f9-6834-4977-ba5a-aff82b30a0f2 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Returning 404 to user: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:23:21.458603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8de3a7f9-6834-4977-ba5a-aff82b30a0f2 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 404 len: 109 microversion: 2.1 time: 0.044011 Jun 24 04:23:21.459036 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 494/961] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:23:21 2022] GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 04:23:21.472892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bfa04ef4-082c-4702-833e-e9707f4bad27 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed16aa60>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:21.505325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-bfa04ef4-082c-4702-833e-e9707f4bad27 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] HTTP exception thrown: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bfa04ef4-082c-4702-833e-e9707f4bad27 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Request method failure captured: Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a HTTP/1.1 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTwvc9KO07zO3lJg0FZzrHYNwGf-f1_KQXPSkyvHdi9V0s5nadcA-cgCwe1sOLISZDOlqVQEshpCGM23s0wIQv5a3qM1VczZia2iM4DqxJQO053IeiLmhbTQjgsyAyMbewvRoHaMA-UH-D74_GPt-ZcJbvSI2TCUG4AAQYz5SMquIC8 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:23:21.507402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6031a2f5e18544b68d3caec584330e42"}]}] Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 2366a2600d2e4821a26c633ddad878e9 Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'b92d9ed2-9bd0-4e0c-bddb-9f670891160a'} Jun 24 04:23:21.515386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. (HTTP 404) (Request-ID: req-cf8b222b-d9c5-4c9f-a2d6-b658cfdeb764) Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.516358 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 04:23:21.517713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 04:23:21.520530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bfa04ef4-082c-4702-833e-e9707f4bad27 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Returning 404 to user: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bfa04ef4-082c-4702-833e-e9707f4bad27 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 404 len: 109 microversion: 2.1 time: 0.039747 Jun 24 04:23:21.521906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 468/962] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:23:21 2022] DELETE /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:23:21.522941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-abdec1a3-d780-4890-9ba1-83fec77f2644 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Calling method '.version_select at 0x7fdfed3884c0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:21.548868 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-abdec1a3-d780-4890-9ba1-83fec77f2644 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] HTTP exception thrown: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-abdec1a3-d780-4890-9ba1-83fec77f2644 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Request method failure captured: Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a HTTP/1.1 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTwvc9KO07zO3lJg0FZzrHYNwGf-f1_KQXPSkyvHdi9V0s5nadcA-cgCwe1sOLISZDOlqVQEshpCGM23s0wIQv5a3qM1VczZia2iM4DqxJQO053IeiLmhbTQjgsyAyMbewvRoHaMA-UH-D74_GPt-ZcJbvSI2TCUG4AAQYz5SMquIC8 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:23:21.550870 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6031a2f5e18544b68d3caec584330e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6031a2f5e18544b68d3caec584330e42"}]}] Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 6031a2f5e18544b68d3caec584330e42 Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2085308306 Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 2366a2600d2e4821a26c633ddad878e9 Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2085308306-project Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'b92d9ed2-9bd0-4e0c-bddb-9f670891160a'} Jun 24 04:23:21.552396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. (HTTP 404) (Request-ID: req-6377820d-9ce7-4e31-a771-3449f2045883) Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.553568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:23:21.554970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 04:23:21.556264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-abdec1a3-d780-4890-9ba1-83fec77f2644 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] Returning 404 to user: Volume b92d9ed2-9bd0-4e0c-bddb-9f670891160a could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-abdec1a3-d780-4890-9ba1-83fec77f2644 tempest-VolumesSnapshotsTestJSON-2085308306 tempest-VolumesSnapshotsTestJSON-2085308306-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a" status: 404 len: 109 microversion: 2.1 time: 0.038797 Jun 24 04:23:21.557595 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 495/963] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:23:21 2022] GET /compute/v2.1/os-volumes/b92d9ed2-9bd0-4e0c-bddb-9f670891160a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 04:23:22.134109 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:22.134740 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:22.145440 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:22.146102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:22.147077 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:22.147671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:22.384265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:22.394030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7599dab6-c5c0-4336-a0a4-079b7ba0b406 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.263511 Jun 24 04:23:22.407369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 469/964] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:22 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:22.461260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:22.462011 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:22.472243 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:22.473354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:22.474235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:22.474935 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:22.702564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:22.713509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:22.718316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:22.720030 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d2b5710d-a4e0-4874-a68f-92ca99ab389e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.263836 Jun 24 04:23:22.735237 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 496/965] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:22 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:23.409888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=4 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:23.424819 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:23.426905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:23.434333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:23.434903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:23.442461 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:23.443606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:23.656005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:23.667267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-20bc9e19-92ad-49ae-8176-07b537a1ab3b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.258156 Jun 24 04:23:23.672872 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 470/966] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:23 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:23.740997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:23.741693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:23.750554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:23.751138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:23.751986 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:23.752631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:23.913741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:23.923087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:23.924828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:23.926038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-11082390-ab39-4aeb-8aef-0213d0e5096a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.189051 Jun 24 04:23:23.937497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 497/967] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:23 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:24.690814 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:24.691370 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:24.697937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:24.698397 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:24.699179 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:24.699612 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:24.843648 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:24.851646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-92ca6291-b8f0-4e4e-94b3-396c1a178219 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.165933 Jun 24 04:23:24.852214 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 471/968] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:24 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:24.944854 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:24.945399 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:24.953439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:24.953886 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:24.954715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:24.955269 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:25.114089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:25.124774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:25.127730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:25.129743 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9073c160-35c7-4604-84f7-e46a1ef1839a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.188760 Jun 24 04:23:25.142331 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 498/969] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:24 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:25.891389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:25.891389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:25.891389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:25.891389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:25.893383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:25.893383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:26.115405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:26.124072 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-89d1f677-5857-476f-80d1-a80e069b2ac6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.257888 Jun 24 04:23:26.124838 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 472/970] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:25 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:26.149281 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:26.150098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:26.156730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:26.157261 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:26.160444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:26.161055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:26.329398 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:26.339436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:26.340962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:26.342790 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b941bfd1-dc94-4a12-958f-3db2ac77af6b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1735 microversion: 2.20 time: 0.197946 Jun 24 04:23:26.343345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 499/971] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:26 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:27.141817 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:27.142793 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:27.149596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:27.150048 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:27.150868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:27.151291 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:27.363389 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:27.364597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:27.365698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:27.372236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:27.373851 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:27.378009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:27.378009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:27.378212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b3c545a5-644c-4703-ae2f-9d8ec5461117 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.238500 Jun 24 04:23:27.378212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 473/972] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:27 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:27.543871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:27.554393 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:27.556109 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:27.557290 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a1594121-c30a-4adb-b815-26753eb84874 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1717 microversion: 2.20 time: 0.200234 Jun 24 04:23:27.557928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 500/973] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:27 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1717 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:27.734127 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-1c5492af-f5cf-4896-8768-235263b0686b req-00c7f7f6-f5fb-4ef7-ab7d-53d38c04becc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "name": "network-vif-plugged", "status": "completed", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:27.742598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-1c5492af-f5cf-4896-8768-235263b0686b req-00c7f7f6-f5fb-4ef7-ab7d-53d38c04becc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:27.742973 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-1c5492af-f5cf-4896-8768-235263b0686b req-00c7f7f6-f5fb-4ef7-ab7d-53d38c04becc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:27.754878 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-1c5492af-f5cf-4896-8768-235263b0686b req-00c7f7f6-f5fb-4ef7-ab7d-53d38c04becc service nova] Creating event network-vif-plugged:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:23:27.759965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-1c5492af-f5cf-4896-8768-235263b0686b req-00c7f7f6-f5fb-4ef7-ab7d-53d38c04becc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 Jun 24 04:23:27.760525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 474/974] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:28.394451 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:28.395058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:28.402193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:28.402668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:28.403459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:28.404543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:28.537171 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:28.544986 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-17865c27-3e1c-4531-9a69-b4c98d52a5df tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.154446 Jun 24 04:23:28.545591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 501/975] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:28 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:28.577688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:28.578411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:28.584477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:28.584929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:28.585693 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:28.586123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:28.737437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:28.746131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:28.748594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:28.749490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-22b9b15e-a2d9-4134-8ad3-911e714d25ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1717 microversion: 2.20 time: 0.177251 Jun 24 04:23:28.750047 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 475/976] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:28 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:29.567787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:29.568676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:29.579579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.580132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:29.580967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.581465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:29.776610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:29.777805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:29.790783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.791417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:29.791855 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:29.792530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.793132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:29.801277 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a33a843e-3821-4ba4-9dd2-898a53c08da2 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.243980 Jun 24 04:23:29.812154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 502/977] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:29 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:29.942262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:29.951033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:29.953099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:29.954311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-571d2e7e-3ad6-4b16-bae8-26ed044e1f9b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1720 microversion: 2.20 time: 0.189845 Jun 24 04:23:29.954893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 476/978] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:29 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:29.973059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3de2a62-f01b-4c90-985e-14de001df02b"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:29.974339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:29.980411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.980852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:29.981600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:29.983156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:30.818969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:30.819548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:30.826195 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:30.826508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:30.827604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:30.827604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:30.988501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:30.997309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d62830e4-f00b-4068-b29c-211608f818e6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1576 microversion: 2.1 time: 0.182149 Jun 24 04:23:31.008700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 477/979] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:30 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:31.557177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-0860f1c5-f302-43fc-afe7-07c4ef95be8b tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.588320 Jun 24 04:23:31.557794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 503/980] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jun 24 04:23:29 2022] POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments => generated 188 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 04:23:31.677704 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:31.678202 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:31.685308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:31.686094 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:31.686964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:31.687316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:31.728220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-7fd01cb8-0b40-4a52-a515-aa559472be30 req-9b8c57c9-94d4-4554-af0a-8b5947345101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "name": "network-vif-unplugged", "status": "completed", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:31.737065 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-7fd01cb8-0b40-4a52-a515-aa559472be30 req-9b8c57c9-94d4-4554-af0a-8b5947345101 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:31.738106 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-7fd01cb8-0b40-4a52-a515-aa559472be30 req-9b8c57c9-94d4-4554-af0a-8b5947345101 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:31.749805 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.compute.server_external_events [req-7fd01cb8-0b40-4a52-a515-aa559472be30 req-9b8c57c9-94d4-4554-af0a-8b5947345101 service nova] Unable to find a host for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45. Dropping event network-vif-unplugged {{(pid=118331) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 04:23:31.750732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-7fd01cb8-0b40-4a52-a515-aa559472be30 req-9b8c57c9-94d4-4554-af0a-8b5947345101 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027338 Jun 24 04:23:31.757226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 504/981] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 24 04:23:32.014679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:32.015370 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:32.021200 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.021647 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.022430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.022871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.158522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:32.165959 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9f73f012-d805-41cc-9d2e-854aa3b6439f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1563 microversion: 2.1 time: 0.155065 Jun 24 04:23:32.166549 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 505/982] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:32 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:32.361096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:32.469680 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5f04fb0a-c3bf-4fc7-8570-2507da3dc417 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments/f3de2a62-f01b-4c90-985e-14de001df02b" status: 202 len: 0 microversion: 2.20 time: 0.795984 Jun 24 04:23:32.470267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 478/983] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jun 24 04:23:31 2022] DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments/f3de2a62-f01b-4c90-985e-14de001df02b => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:23:32.526704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:32.527260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:32.539652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.539652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.539652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.539652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.747081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2639f488-8a2e-4616-bad0-44c40fc50cd9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/action" status: 202 len: 0 microversion: 2.20 time: 0.224551 Jun 24 04:23:32.747897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 506/984] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jun 24 04:23:32 2022] POST /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:23:32.756347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:32.757188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:32.766849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.767596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.768373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:32.768889 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:32.901624 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:32.912464 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:32.914033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:32.915267 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e35537bf-23af-49f1-96cd-fd56271fcc4e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1668 microversion: 2.20 time: 0.162832 Jun 24 04:23:32.920349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 479/985] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:32 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:33.277895 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-228376671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716432859", "security_groups": [{"name": "tempest-secgroup-smoke-109829358"}], "block_device_mapping_v2": [{"uuid": "bc6e67c9-69bd-4cea-ad67-e86530a7f0c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a202b9e8-77c8-471b-bad0-c0f2e233e837"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:33.407075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] validate_networks() for [('a202b9e8-77c8-471b-bad0-c0f2e233e837', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:23:33.792491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:23:33.792491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:23:33.792491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:23:33.792491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:23:33.793295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:23:33.802350 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:33.802824 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:33.803624 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:33.804093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:33.821326 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:23:33.825458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for user d1cee676e3dc47e18e94de7e20b59455 and project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:23:33.882600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:23:33.884732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc6e67c9-69bd-4cea-ad67-e86530a7f0c6',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:23:33.934192 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:33.935409 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:33.942325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:33.942811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:33.943574 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:33.944058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:34.087068 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:34.097965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:34.107599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:34.107599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-343794e9-e0f8-440f-b964-7914113ff382 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1668 microversion: 2.20 time: 0.170358 Jun 24 04:23:34.107599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 480/986] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:33 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:34.294729 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-24afb925-2b5e-45d0-b10a-a14a6e460738 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.021227 Jun 24 04:23:34.295328 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 507/987] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:23:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:23:34.305224 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b66c3c1a-446c-410f-aa57-4225999e88b5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:34.305857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b66c3c1a-446c-410f-aa57-4225999e88b5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:34.361982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b66c3c1a-446c-410f-aa57-4225999e88b5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:34.370003 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b66c3c1a-446c-410f-aa57-4225999e88b5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1093 microversion: 2.1 time: 0.068570 Jun 24 04:23:34.370613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 481/988] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:34 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:35.120234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:35.120847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:35.131961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:35.131961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:35.131961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:35.131961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:35.272428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:35.281411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:35.282926 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:35.284087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d3edc87f-4639-4961-b794-a773e4b1386a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.168425 Jun 24 04:23:35.295126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 508/989] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:35 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:35.387007 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-15d8194d-4098-4c85-8216-7c95d89d3545 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:35.387606 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-15d8194d-4098-4c85-8216-7c95d89d3545 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:35.455868 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-15d8194d-4098-4c85-8216-7c95d89d3545 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:35.464912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-15d8194d-4098-4c85-8216-7c95d89d3545 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1093 microversion: 2.1 time: 0.081754 Jun 24 04:23:35.465464 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 482/990] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:35 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:36.303856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:36.304459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:36.311022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:36.311450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:36.312212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:36.312640 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:36.455487 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:36.467712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:36.469717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:36.471425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-92b9ea2a-5f9b-4a48-9048-e8a432f84932 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.171370 Jun 24 04:23:36.472619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 509/991] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:36 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:36.492837 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:36.495437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:36.518430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:36.520603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:36.522792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:36.523379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:36.626887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:36.637489 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1eede8a6-61f2-448e-a3f8-a71933aaf14d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.159907 Jun 24 04:23:36.640597 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 483/992] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:36 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:37.495769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:37.497305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:37.506311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:37.509343 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:37.510340 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:37.510919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:37.517041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:37.666769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:37.668227 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:37.679131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:37.681419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:37.683234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:37.683683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:37.708345 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:37.719893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:37.719893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:37.720934 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-439cb77c-0eba-4212-bbbf-e7c5e985ba15 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.229918 Jun 24 04:23:37.721550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 510/993] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:37 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:37.785588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:37.793212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9e0a992e-ce85-47e0-adfc-7cbf9bf363c3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.137952 Jun 24 04:23:37.793887 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 484/994] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:37 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:38.388410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:38.388911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:38.395057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.400431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.400431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.400431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.428881 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-06b35c3f-5098-4e65-ae07-abbe3efc7f49 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/ips" status: 200 len: 146 microversion: 2.1 time: 0.044686 Jun 24 04:23:38.430079 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 511/995] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:23:38 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:38.739861 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:38.740457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:38.747820 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.748272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.749055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.750469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.815461 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:38.816792 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:38.828273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.828419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.829422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:38.829995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:38.920589 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:38.928904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-974c7665-fbac-4223-bbf5-c005825fb7a6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.119760 Jun 24 04:23:38.929811 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 512/996] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:38 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:38.955176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:38.964528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:38.965432 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:38.966753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6067df53-0bf2-4ce7-a2fc-1d5732f19e4d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.230823 Jun 24 04:23:38.977668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 485/997] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:38 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:39.946600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:39.947540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:39.955349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:39.957691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:39.957691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:39.957691 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:39.985841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:39.987422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:40.000945 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:40.001656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:40.004147 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:40.004890 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:40.056767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:40.066621 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5efa4489-34de-4635-bb60-b108089521e9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.124125 Jun 24 04:23:40.079454 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 513/998] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:39 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:40.217379 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:40.227910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:40.229735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:40.231879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5fd2cbc1-fa0a-4e2f-8a55-1c586ef846ed tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.250089 Jun 24 04:23:40.233199 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 486/999] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:39 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:40.260772 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c31aebf0-eac7-4b20-a457-8260f92798f5"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:40.261912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:40.270124 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:40.270859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:40.273732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:40.274469 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.039627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:41.041080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:41.048987 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.049725 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.051324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.051993 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.091995 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c19c1d2f-c084-47ce-8865-37402887f1a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/ips" status: 200 len: 151 microversion: 2.1 time: 0.056231 Jun 24 04:23:41.092904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 487/1000] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:23:41 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:41.097968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:41.098895 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:41.107075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.107075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.107075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.107815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.213058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:41.235761 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7cdc9705-b4b4-4a77-ad4b-33945147ebe3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.141530 Jun 24 04:23:41.236453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 488/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:41 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:41.251906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:41.253498 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:41.261565 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.262257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.264525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:41.265129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:41.423984 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:41.433742 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:41.435969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:41.437513 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2512730c-f63e-4e2f-b9b3-e395838e1715 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.190655 Jun 24 04:23:41.452758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 489/1002] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:41 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:42.255317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:42.255960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:42.264600 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.268590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:42.268590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.268590 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:42.513940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:42.521968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5a0d3706-789d-4826-a3ce-4a0d165104d8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1191 microversion: 2.1 time: 0.271831 Jun 24 04:23:42.523062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 490/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:42 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1191 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:23:42.528483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:42.529402 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:42.536450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.537247 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:42.538669 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.539012 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:42.697021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:42.707205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:42.709441 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:42.710829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9000e32f-3108-4c60-b47c-ed8fb8e5a7b9 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.186496 Jun 24 04:23:42.721413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 491/1004] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:42 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:42.844656 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57692c35-d3f8-40cf-96f1-55468a26e292"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:42.846095 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:42.857933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.858487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:42.859299 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:42.859824 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:43.813673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:43.832342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:45.462809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=4 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:46.338919 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d24d5e08-46a8-4b93-a03a-5cf95f5e0b61 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.082276 Jun 24 04:23:46.344623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 514/1005] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:23:40 2022] POST /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 194 bytes in 6084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:46.345244 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:46.346293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:46.348979 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:46.356336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:46.356787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:46.357567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:46.358021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:46.366978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f0ec5736-d59f-4ab9-9e94-052d16f0a594 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "POST /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.526492 Jun 24 04:23:46.372727 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 492/1006] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:23:42 2022] POST /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 194 bytes in 3528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:23:46.384162 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:46.384866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:46.386880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:46.400188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:46.400635 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:46.401812 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:46.402251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:46.428741 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:46.439244 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f6af3b4d-4ede-4c54-bfa0-ef66f04baa37 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1209 microversion: 2.1 time: 0.098522 Jun 24 04:23:46.449426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 515/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:46 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:46.535446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:46.543647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:46.545141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:46.546679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0f7f66ed-3f98-4c81-8c5c-64d33417d690 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.177503 Jun 24 04:23:46.547246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 493/1008] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:46 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:47.459768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:47.460461 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:47.467707 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:47.468355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:47.469018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:47.469460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:47.532961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:47.540432 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5871b6ba-e190-4d83-9581-3f321620957f tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1209 microversion: 2.1 time: 0.084534 Jun 24 04:23:47.540988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 516/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:47 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:47.565154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:47.565764 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:47.572794 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:47.573244 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:47.574001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:47.574477 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:47.707847 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:47.715880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:47.719171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:47.719171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-bbe021d1-d382-42ec-a04d-293fa899ab29 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.158285 Jun 24 04:23:47.719559 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 494/1010] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:47 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:48.556828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:48.557719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:48.564863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:48.565295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:48.566076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:48.566535 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:48.627848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:48.636175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-363cc6c3-3a99-4ff5-9280-c9bdd8e6cba7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1209 microversion: 2.1 time: 0.083059 Jun 24 04:23:48.636755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 517/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:48 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:48.737047 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:48.737619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:48.744049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:48.744494 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:48.745255 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:48.745690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:48.885616 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:48.894730 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:48.896273 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:48.897415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-647ea3f1-fb5e-44ca-8172-db69f188dfd8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.164396 Jun 24 04:23:48.897960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 495/1012] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:48 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:49.654643 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:49.656023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:49.662582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:49.663037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:49.663802 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:49.664234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:49.730698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:49.738684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-42d8af6c-887c-4ea0-abbe-9c68239186ef tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1209 microversion: 2.1 time: 0.088156 Jun 24 04:23:49.739570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 518/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:49 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:49.916474 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:49.917083 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:49.926235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:49.926235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:49.926235 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:49.926568 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:49.930451 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:50.063821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:50.071906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:50.073405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:50.074599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4034cd1c-c000-489f-ac91-7d600f5682da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.162046 Jun 24 04:23:50.075202 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 496/1014] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:49 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:50.756192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:50.756969 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:50.765128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:50.765858 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:50.768770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:50.769436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:50.937853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:50.946037 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eea1cf94-ef96-4e9b-a829-8df8fa562c25 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1276 microversion: 2.1 time: 0.193859 Jun 24 04:23:50.946829 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 519/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:50 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:51.082155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-3ff332aa-481d-4283-9809-970e786b952e req-da966fba-ef99-4304-8566-fc400c8c7b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0901d6-f9f8-423b-872f-c51e28ede6a9", "tag": "fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:51.092072 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3ff332aa-481d-4283-9809-970e786b952e req-da966fba-ef99-4304-8566-fc400c8c7b7b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:51.093067 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3ff332aa-481d-4283-9809-970e786b952e req-da966fba-ef99-4304-8566-fc400c8c7b7b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:51.094669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:51.095373 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:51.103049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:51.107041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:51.107041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:51.107041 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:51.109544 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-3ff332aa-481d-4283-9809-970e786b952e req-da966fba-ef99-4304-8566-fc400c8c7b7b service nova] Creating event network-changed:fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24 for instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 on hv-cinder-84684 Jun 24 04:23:51.115404 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-3ff332aa-481d-4283-9809-970e786b952e req-da966fba-ef99-4304-8566-fc400c8c7b7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039446 Jun 24 04:23:51.116341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 497/1016] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:51.259222 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:51.267564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:51.269101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:51.270331 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3814992b-a7d3-4bdc-96b7-2f351b7a9b45 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.181280 Jun 24 04:23:51.270911 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 520/1017] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:51 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 04:23:51.965060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:51.965741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:51.972678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:51.973119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:51.973866 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:51.974295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:52.105242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:52.113344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fd20e07c-09df-45bc-879b-da6b6d4841b6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.152814 Jun 24 04:23:52.113897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 498/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:51 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:52.289283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:52.289927 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:52.297038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:52.297558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:52.298344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:52.298825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:52.430930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:52.439326 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:52.440936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:52.441966 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ccf3a4c2-1e44-49ef-836c-f04a91c2af96 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.156709 Jun 24 04:23:52.442719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 521/1019] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:52 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:53.130783 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:53.131389 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:53.137896 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:53.138340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:53.139128 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:53.139553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:53.284494 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:53.291934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-199a7927-2848-4c13-aaaf-d9d27a00bed6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.165175 Jun 24 04:23:53.292569 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 499/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:53 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:53.464093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:53.464093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:53.466735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:53.467684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:53.468529 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:53.468981 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:53.603253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:53.611794 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:53.613319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:53.614501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e1407a59-d7a0-4474-9d1f-0864da0b00ea tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.158669 Jun 24 04:23:53.615054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 522/1021] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:53 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:54.309668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:54.310314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:54.317170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:54.317619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:54.318392 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:54.318829 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:54.535746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:54.543327 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1e0b09b5-a2aa-4f22-a141-ab0716669099 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.238032 Jun 24 04:23:54.543964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 500/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:54 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:54.632897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:54.633497 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:54.640489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:54.640929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:54.641788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:54.642214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:54.772088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:54.780362 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:54.781875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:54.783078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-97a480d5-fb0b-4460-8f7e-20662d03da2d tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.154189 Jun 24 04:23:54.783633 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 523/1023] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:54 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:55.560678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:55.561266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:55.568970 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:55.569413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:55.570172 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:55.570625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:55.704935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:55.712523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ad599d12-8f9e-4d2e-bf77-7047cd7234ec tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.155673 Jun 24 04:23:55.713143 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 501/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:55 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:55.801245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:55.802540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:55.809084 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:55.809568 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:55.810319 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:55.810774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:55.944513 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:55.952510 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:55.954150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:55.955383 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4b9633a0-d780-4041-8682-b16d38058bf8 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.158299 Jun 24 04:23:55.955908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 524/1025] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:55 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:56.246588 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-bf705e72-184b-4e5a-8029-afd4a8057a9e req-531f44a3-668a-4a2e-9274-f8a0b5a192ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "name": "network-vif-plugged", "status": "completed", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:23:56.255739 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-bf705e72-184b-4e5a-8029-afd4a8057a9e req-531f44a3-668a-4a2e-9274-f8a0b5a192ba service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:56.256300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-bf705e72-184b-4e5a-8029-afd4a8057a9e req-531f44a3-668a-4a2e-9274-f8a0b5a192ba service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:56.268110 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-bf705e72-184b-4e5a-8029-afd4a8057a9e req-531f44a3-668a-4a2e-9274-f8a0b5a192ba service nova] Creating event network-vif-plugged:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:23:56.273306 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-bf705e72-184b-4e5a-8029-afd4a8057a9e req-531f44a3-668a-4a2e-9274-f8a0b5a192ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 Jun 24 04:23:56.273900 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 502/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:23:56.729255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:56.729856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:56.736467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:56.736900 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:56.737652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:56.738079 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:56.868499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:56.871944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:23:56.876958 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1faa589c-7ade-4f72-8dfa-e711b222266b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.151556 Jun 24 04:23:56.877531 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 525/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:56 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:56.974266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:56.974932 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:56.981594 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:56.982042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:56.982826 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:56.983260 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:57.117979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:57.126320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:57.127825 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:57.128959 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e9506333-2b04-4036-a438-f26fccbc54fd tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.159099 Jun 24 04:23:57.129497 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 503/1028] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:56 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:57.893017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:57.893624 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:57.901293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:57.901739 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:57.902528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:57.902962 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:58.064533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:58.074581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b538f84b-3c54-455f-9045-cb65a0831c3d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.185435 Jun 24 04:23:58.075980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 526/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:57 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:58.147303 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:58.148603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:58.156558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:58.157563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:58.158609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:58.159509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:58.323708 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:58.331969 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:58.333462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:58.334660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-be16bfb8-825c-4188-86b1-bead96602845 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.191334 Jun 24 04:23:58.335217 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 504/1030] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:58 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:23:59.097846 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:59.098487 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:59.105408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:59.105863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:59.106704 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:59.107138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:59.267764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:59.275596 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e24cf3b7-30b4-4620-8605-4ef16e24fa48 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.182363 Jun 24 04:23:59.276147 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 527/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:23:59 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:23:59.352874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:23:59.353423 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:23:59.359974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:59.360410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:59.361160 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:23:59.361586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:23:59.496451 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:59.505601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:59.507209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:23:59.508448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-198a3ea1-3cbd-4bae-8be8-d2db7fefb426 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1726 microversion: 2.20 time: 0.159518 Jun 24 04:23:59.509049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 505/1032] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:23:59 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:00.292656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:00.293291 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:00.300901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:00.301414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:00.302179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:00.302632 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:00.430481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:00.437859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8e1b587b-077b-4484-a294-88860caecc20 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.149065 Jun 24 04:24:00.438889 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 528/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:00 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:00.528131 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:00.528672 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:00.540586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:00.540586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:00.540586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:00.540586 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:00.667384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:00.675501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:00.676978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:00.678115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b8e8a0b6-2346-4a1f-a3be-67e1dce3cf3a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1713 microversion: 2.20 time: 0.154752 Jun 24 04:24:00.678691 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 506/1034] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:00 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:01.455104 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:01.455712 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:01.462336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:01.462804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:01.463556 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:01.463980 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:01.598590 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:01.603189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8b47e2ac-11ba-4a7d-93c6-7e9547edc01c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.152611 Jun 24 04:24:01.603752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 529/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:01 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:02.619821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:02.620361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:02.626916 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:02.627370 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:02.628135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:02.628603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:02.760384 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:02.768882 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c25be6e0-609d-4ecc-9ee7-3c2dff9faa6b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.152990 Jun 24 04:24:02.769470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 507/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:02 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:03.786842 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:03.787496 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:03.793940 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:03.794395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:03.795168 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:03.795591 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:03.930052 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:03.937601 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-474384bb-1ac5-41fb-a681-19547d92720d tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.154827 Jun 24 04:24:03.939088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 530/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:03 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:24:04.536446 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:04.537394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:04.543994 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.544437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:04.545196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.545627 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:04.576956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9123ff22-c42c-4e0e-8334-da3579aa68df tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Jun 24 04:24:04.577501 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 508/1038] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:04 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:04.588191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:04.588683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:04.595040 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.595492 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:04.596255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.596692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:04.625122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3df968eb-f5b4-423a-afaa-12f121c988b8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5" status: 200 len: 194 microversion: 2.1 time: 0.040812 Jun 24 04:24:04.626513 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 531/1039] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jun 24 04:24:04 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:04.955619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:04.956219 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:04.962148 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.966649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:04.966649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:04.966649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:05.100067 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:05.107523 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d6d5a2b1-7640-4952-993e-9adf41bac368 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.155684 Jun 24 04:24:05.108074 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 509/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:04 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:06.123957 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:06.124593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:06.131232 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:06.131675 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:06.132428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:06.132864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:06.264434 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "036f6e57-cd3f-4cd3-a286-f4f84bdd5903"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:06.265478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:06.272773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:06.273231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:06.274059 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:06.274791 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:06.277054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:06.285082 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-98d12607-4f5b-478d-a159-e0baf3c432e4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.165081 Jun 24 04:24:06.285848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 532/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:06 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:06.382343 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-c0e83879-b992-443c-8bbd-b8c01009ce12 req-01e95c66-f4e2-4366-8fcd-6733051bf45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0901d6-f9f8-423b-872f-c51e28ede6a9", "name": "network-vif-plugged", "status": "completed", "tag": "fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:06.392177 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-c0e83879-b992-443c-8bbd-b8c01009ce12 req-01e95c66-f4e2-4366-8fcd-6733051bf45b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:06.392658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-c0e83879-b992-443c-8bbd-b8c01009ce12 req-01e95c66-f4e2-4366-8fcd-6733051bf45b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:06.404478 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-c0e83879-b992-443c-8bbd-b8c01009ce12 req-01e95c66-f4e2-4366-8fcd-6733051bf45b service nova] Creating event network-vif-plugged:fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24 for instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 on hv-cinder-84684 Jun 24 04:24:06.410498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-c0e83879-b992-443c-8bbd-b8c01009ce12 req-01e95c66-f4e2-4366-8fcd-6733051bf45b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 Jun 24 04:24:06.415108 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 533/1042] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:07.113927 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-29628aa3-afdb-4361-8845-145ecc7a98e1 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "POST /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853240 Jun 24 04:24:07.114534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 510/1043] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:24:06 2022] POST /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:07.304400 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:07.305103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:07.311278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:07.311721 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:07.312465 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:07.313652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:07.443929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:07.451382 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-034c36e9-ae5c-4bc3-82ff-671385d74dcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.151638 Jun 24 04:24:07.451933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 534/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:07 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:24:08.469178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:08.470058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:08.476167 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:08.476620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:08.477387 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:08.477823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:08.622790 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:08.631024 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d3b19eb1-e75e-4901-b8a0-3c3357bf93a9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1264 microversion: 2.1 time: 0.166774 Jun 24 04:24:08.631611 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 511/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:08 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:09.648459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:09.649073 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:09.655961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:09.657711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:09.658287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:09.658753 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:09.804480 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:09.816289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c68c49e5-4b7e-4405-b4a3-5c54569d1336 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1452 microversion: 2.1 time: 0.168301 Jun 24 04:24:09.816289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 535/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:09 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:09.830231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:09.831027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:09.839361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:09.839361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:09.839907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:09.840494 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:10.021690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:10.025636 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:10.030225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2831f06d-2d11-477f-bbbd-c2fd3c62f4cd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1452 microversion: 2.1 time: 0.203972 Jun 24 04:24:10.040363 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 512/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:09 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:24:11.027174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:11.027757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:11.034354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:11.035043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:11.036025 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:11.036468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:11.123402 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'services' on Instance uuid 87b70b01-cc71-40ad-a0dc-efe093913399 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:11.333864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b561a97c-52f5-4a2b-9589-b8b21cf514a7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments/57692c35-d3f8-40cf-96f1-55468a26e292" status: 202 len: 0 microversion: 2.1 time: 0.310642 Jun 24 04:24:11.334918 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 536/1048] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:24:11 2022] DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments/57692c35-d3f8-40cf-96f1-55468a26e292 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:24:11.343943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:11.346126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:11.354301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:11.354301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:11.355421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:11.355798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:11.395133 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8f71aeb8-47d0-472a-9009-cb8e62d048b0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055554 Jun 24 04:24:11.395822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 513/1049] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:11 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:12.387770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-d613040b-8278-4c23-88c9-e703bd23840c req-c0999e57-a22b-4fe9-aa60-20f39a2b41c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0901d6-f9f8-423b-872f-c51e28ede6a9", "tag": "fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:12.397611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d613040b-8278-4c23-88c9-e703bd23840c req-c0999e57-a22b-4fe9-aa60-20f39a2b41c0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:12.398058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-d613040b-8278-4c23-88c9-e703bd23840c req-c0999e57-a22b-4fe9-aa60-20f39a2b41c0 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:12.410561 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-d613040b-8278-4c23-88c9-e703bd23840c req-c0999e57-a22b-4fe9-aa60-20f39a2b41c0 service nova] Creating event network-changed:fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24 for instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 on hv-cinder-84684 Jun 24 04:24:12.411105 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:12.412713 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:12.423943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:12.425187 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:12.426338 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:12.427000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:12.437306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-d613040b-8278-4c23-88c9-e703bd23840c req-c0999e57-a22b-4fe9-aa60-20f39a2b41c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053404 Jun 24 04:24:12.441618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 537/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:12.467718 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6d59504b-cf0e-4922-b694-fbb2d41c6288 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064239 Jun 24 04:24:12.468422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 514/1051] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:12 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:13.481422 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:13.482621 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:13.489618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:13.490114 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:13.491027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:13.491618 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:13.529819 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bc8e4124-e7b9-4af4-a27e-2da7e63025c7 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053318 Jun 24 04:24:13.533122 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 538/1052] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:13 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:14.541797 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:14.542734 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:14.550723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:14.551169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:14.551935 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:14.552365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:14.586589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5cd79efb-65e7-4232-8063-cb65a27aa3ad tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049084 Jun 24 04:24:14.587538 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 515/1053] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:14 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:15.599514 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:15.600354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:15.606942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:15.607387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:15.608150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:15.608580 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:15.640828 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-12e9eb84-124f-4493-9ceb-3365cfd95004 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046173 Jun 24 04:24:15.641961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 539/1054] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:15 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:16.653780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:16.654731 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:16.663119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:16.663728 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:16.664324 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:16.664753 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:16.696857 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7b1821c3-10b9-4b41-9ec4-ce3304c34150 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Jun 24 04:24:16.697466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 516/1055] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:16 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:17.708038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:17.709017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:17.711832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=50 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:17.716832 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:17.717280 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:17.718159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:17.718630 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:17.755217 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b632a601-0bd7-4813-ad81-81e8b15a26f3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051310 Jun 24 04:24:17.755784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 540/1056] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:17 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:18.767532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:18.768412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:18.770821 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=48 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:18.776091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:18.776561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:18.777331 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:18.777784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:18.809746 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3cc4890a-cb1d-441a-9a6e-b5b0160ba104 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Jun 24 04:24:18.811698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 517/1057] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:18 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:18.932156 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:18.932997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:18.940223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:18.940669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:18.941439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:18.941873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:18.974658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e129c253-424d-4897-a54d-5255eed6a25f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046894 Jun 24 04:24:18.975247 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 541/1058] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:18 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:19.125937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:19.127027 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:19.133087 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.133534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.134294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.134752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.164601 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8d88b320-6cc2-40c9-ae47-0d8a780b9439 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5" status: 200 len: 194 microversion: 2.1 time: 0.042598 Jun 24 04:24:19.165195 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 518/1059] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jun 24 04:24:19 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:19.175995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:19.176487 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:19.182649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.183140 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.184034 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.184470 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.271573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lazy-loading 'services' on Instance uuid ca634131-d896-451a-8213-b55471341fa6 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:19.275450 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:19.472937 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3ddf1374-795f-4a74-953b-63316a6d2f80 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5" status: 202 len: 0 microversion: 2.1 time: 0.301322 Jun 24 04:24:19.473437 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 542/1060] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:24:19 2022] DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/c31aebf0-eac7-4b20-a457-8260f92798f5 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:24:19.825310 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:19.826205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:19.833860 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.841941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.841941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.841941 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.869046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-80417923-2938-40db-a0f1-ac7cc375636a tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047885 Jun 24 04:24:19.869600 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 519/1061] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:19 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:24:19.929896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:19.930504 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:19.937181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.937751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.938347 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:19.939997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:19.965170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:24:20.242565 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f5ad436e-bff0-4d6d-b2a4-83c3e291d5a8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 204 len: 0 microversion: 2.1 time: 0.316864 Jun 24 04:24:20.243179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 543/1062] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:19 2022] DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:24:20.251280 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:20.251879 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:20.257877 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:20.258320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:20.259107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:20.259537 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:20.394206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:20.402146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-af57507d-5c39-4949-9fac-e47330a3c6a0 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1683 microversion: 2.1 time: 0.154678 Jun 24 04:24:20.405171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 520/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:20 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:21.420479 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:21.421176 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:21.428471 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.428913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.429674 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.430104 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.565801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:21.573331 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45689152-5e33-4670-a0d0-0c5abb8371b3 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1683 microversion: 2.1 time: 0.157172 Jun 24 04:24:21.573888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 544/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:21 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:21.640859 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:21.643784 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:21.647906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.648359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.649119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.649869 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.680083 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2b9e2314-7fe7-4247-bade-7b313c2985f7 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/036f6e57-cd3f-4cd3-a286-f4f84bdd5903" status: 200 len: 194 microversion: 2.1 time: 0.043040 Jun 24 04:24:21.680584 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 521/1065] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jun 24 04:24:21 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/036f6e57-cd3f-4cd3-a286-f4f84bdd5903 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:21.690526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:21.691021 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:21.697060 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.697508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.698272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:21.698744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:21.778767 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lazy-loading 'services' on Instance uuid ca634131-d896-451a-8213-b55471341fa6 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:21.996863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d2f26fc9-dd2c-478a-b045-397419ba0483 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/036f6e57-cd3f-4cd3-a286-f4f84bdd5903" status: 202 len: 0 microversion: 2.1 time: 0.310085 Jun 24 04:24:21.997447 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 545/1066] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:24:21 2022] DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments/036f6e57-cd3f-4cd3-a286-f4f84bdd5903 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:24:22.593351 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:22.594231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:22.603075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:22.603526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:22.604872 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:22.605316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:22.826531 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:22.834559 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3be36ea9-bd1f-46ae-b400-6b33bc2c7a5f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1683 microversion: 2.1 time: 0.245466 Jun 24 04:24:22.835114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 522/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:22 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:23.244878 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-49858dc9-e376-46f4-a2e6-58f2e6939899 req-aecf736c-03ea-4c73-873a-fef98d5dd455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b70b01-cc71-40ad-a0dc-efe093913399", "name": "network-vif-deleted", "tag": "40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:23.264242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-49858dc9-e376-46f4-a2e6-58f2e6939899 req-aecf736c-03ea-4c73-873a-fef98d5dd455 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:23.264680 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-49858dc9-e376-46f4-a2e6-58f2e6939899 req-aecf736c-03ea-4c73-873a-fef98d5dd455 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:23.276521 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-49858dc9-e376-46f4-a2e6-58f2e6939899 req-aecf736c-03ea-4c73-873a-fef98d5dd455 service nova] Creating event network-vif-deleted:40cd0a45-e8fc-4cc1-a3b1-25f30ab1c4e6 for instance 87b70b01-cc71-40ad-a0dc-efe093913399 on hv-cinder-84684 Jun 24 04:24:23.281425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-49858dc9-e376-46f4-a2e6-58f2e6939899 req-aecf736c-03ea-4c73-873a-fef98d5dd455 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041534 Jun 24 04:24:23.282248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 546/1068] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:23.852121 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:23.852723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:23.859687 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:23.860208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:23.860983 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:23.861457 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:23.896329 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:23.896773 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:23.897224 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lazy-loading 'fault' on Instance uuid 87b70b01-cc71-40ad-a0dc-efe093913399 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:23.942042 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114d227e9645409e9082cf9b09b05c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7130ecbc4d487db66baebeab8550b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:23.953194 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8e0cd00b-b1ce-4e8b-99ca-a123beae1411 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 200 len: 1331 microversion: 2.1 time: 0.104972 Jun 24 04:24:23.953888 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 523/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:23 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:24.233660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:24.235085 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:24.243075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.243517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.244283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.244711 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.277342 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-30004b27-9976-4ce4-8f2b-c6f3e8d7e58d tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050442 Jun 24 04:24:24.278960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 547/1070] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:24 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:24:24.395173 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:24.396706 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:24.403490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.403931 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.404799 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.405265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.436020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1ef6a236-6d82-4f24-866f-a288b1505605 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045253 Jun 24 04:24:24.436591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 524/1071] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jun 24 04:24:24 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 04:24:24.496203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:24.496696 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:24.502788 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.503327 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.504080 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.504507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.530914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:24:24.801236 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d4d1a511-5cdd-4e15-8b2e-c046701a5c30 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 204 len: 0 microversion: 2.1 time: 0.308435 Jun 24 04:24:24.801829 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 548/1072] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:24 2022] DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:24:24.810205 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:24.810843 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:24.817932 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.818393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.819163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.819598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.955393 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:24.963614 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f09d0981-d021-4427-baaf-ec8331630bb3 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1674 microversion: 2.1 time: 0.157104 Jun 24 04:24:24.964102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 525/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:24 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:24:24.972977 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:24.973667 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:24.979715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.980159 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.980917 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:24.981349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:24.995231 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 HTTP/1.1 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:24.996874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:24.998642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '87b70b01-cc71-40ad-a0dc-efe093913399'} Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:25.000174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:25.003545 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:25.005572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:25.005572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-aa74f260-fa5c-457e-8759-2efa902243a9 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 404 len: 111 microversion: 2.1 time: 0.029529 Jun 24 04:24:25.005572 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 549/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:24 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:25.008470 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-add29a6d-3c5c-4e5c-bdd1-5714726dc005 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '.version_select at 0x7fdfed1dd1f0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:25.088066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-add29a6d-3c5c-4e5c-bdd1-5714726dc005 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034357895" status: 202 len: 0 microversion: 2.1 time: 0.083379 Jun 24 04:24:25.088700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 526/1075] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jun 24 04:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034357895 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:24:25.981537 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:25.982150 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:25.989405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:25.989897 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:25.990692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:25.991127 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:26.123254 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:26.130809 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fcf05212-ce02-4b2d-8d76-a9bbca41e0e8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1674 microversion: 2.1 time: 0.153911 Jun 24 04:24:26.131401 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 550/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:25 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:27.031185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:27.031670 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:27.038448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.038901 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.039659 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.040094 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.053668 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 HTTP/1.1 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:27.055347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.056940 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '87b70b01-cc71-40ad-a0dc-efe093913399'} Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:27.057741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.059062 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.060333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:27.060333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f0781d7b-96b5-40c7-b597-09e3c952aad8 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 404 len: 111 microversion: 2.1 time: 0.029375 Jun 24 04:24:27.060333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 527/1077] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:27 2022] DELETE /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:27.065815 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:27.066444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: 87b70b01-cc71-40ad-a0dc-efe093913399] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:27.073016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.073462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.074216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.074672 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.088257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 HTTP/1.1 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:27.089764 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.091372 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '87b70b01-cc71-40ad-a0dc-efe093913399'} Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:27.092279 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. Jun 24 04:24:27.093744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:27.095165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance 87b70b01-cc71-40ad-a0dc-efe093913399 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:27.095165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-5c7b568b-0c44-4d8a-bc43-ed7d0963c7d6 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399" status: 404 len: 111 microversion: 2.1 time: 0.029760 Jun 24 04:24:27.095165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 551/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:27 2022] GET /compute/v2.1/servers/87b70b01-cc71-40ad-a0dc-efe093913399 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:27.148406 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:27.149170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:27.155461 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.155904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.156654 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:27.157078 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:27.727310 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:27.735383 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-88f8a4fe-fa12-40e2-a397-908c572a281c tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1674 microversion: 2.1 time: 0.590726 Jun 24 04:24:27.736171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 528/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:27 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1674 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:28.415574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:28.419299 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:28.423927 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.425077 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.425214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.425821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.440573 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 HTTP/1.1 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:28.444315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.445673 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f9ac8aeb-d87b-48df-9a78-d17d9a2967a3'} Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:28.447018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.448322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.449574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:28.449574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1acc082b-482f-4884-b3b7-c9c0efcc017f tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 404 len: 111 microversion: 2.1 time: 0.032059 Jun 24 04:24:28.449574 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 552/1080] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:28 2022] DELETE /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:28.454986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:28.455676 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f9ac8aeb-d87b-48df-9a78-d17d9a2967a3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:28.463139 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.463651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.464425 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.464862 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.479033 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 HTTP/1.1 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:28.480609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.482134 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'f9ac8aeb-d87b-48df-9a78-d17d9a2967a3'} Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:28.483041 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. Jun 24 04:24:28.484518 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.485827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:28.485827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-dd872d9e-13a4-4641-88a4-5f4e34a3c902 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3" status: 404 len: 111 microversion: 2.1 time: 0.030851 Jun 24 04:24:28.485827 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 529/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:28 2022] GET /compute/v2.1/servers/f9ac8aeb-d87b-48df-9a78-d17d9a2967a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:28.490960 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:28.491455 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:28.497424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.497869 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.498653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.499272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.513103 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 HTTP/1.1 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:28.514660 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.516242 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'a1608c2b-a5ad-45f3-8e24-790fd53cbe49'} Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:28.517149 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.519337 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.521191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:28.521191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b5980eb0-4d11-4b9e-88fe-87d4b151d182 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 404 len: 111 microversion: 2.1 time: 0.029144 Jun 24 04:24:28.521191 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 553/1082] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:28 2022] DELETE /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:28.525343 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:28.525938 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: a1608c2b-a5ad-45f3-8e24-790fd53cbe49] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:28.532312 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.532759 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.533553 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.533979 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.547593 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 HTTP/1.1 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:28.549135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.550789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'a1608c2b-a5ad-45f3-8e24-790fd53cbe49'} Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:28.554804 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. Jun 24 04:24:28.556265 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:28.557698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance a1608c2b-a5ad-45f3-8e24-790fd53cbe49 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:28.557698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a2c4e0ae-9c66-4d28-ba08-d38949baac40 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49" status: 404 len: 111 microversion: 2.1 time: 0.029237 Jun 24 04:24:28.557698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 530/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:28 2022] GET /compute/v2.1/servers/a1608c2b-a5ad-45f3-8e24-790fd53cbe49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:28.753751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:28.754380 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:28.761014 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.768530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.768530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.768530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.839945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:28.849087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1404d36b-86c9-4c71-8d1d-f62c5b528df9 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1607 microversion: 2.1 time: 0.099801 Jun 24 04:24:28.849955 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 554/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:28 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1607 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:28.898180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-914ad41b-ad33-4fdb-b43c-eed6fd898b6a req-2acf23bb-3680-41e5-a808-77cb5c825c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca634131-d896-451a-8213-b55471341fa6", "name": "network-vif-deleted", "tag": "04c693b8-b0c5-4480-a278-08e6a78747c0"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:28.907049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-914ad41b-ad33-4fdb-b43c-eed6fd898b6a req-2acf23bb-3680-41e5-a808-77cb5c825c8b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:28.907490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-914ad41b-ad33-4fdb-b43c-eed6fd898b6a req-2acf23bb-3680-41e5-a808-77cb5c825c8b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:28.920015 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-914ad41b-ad33-4fdb-b43c-eed6fd898b6a req-2acf23bb-3680-41e5-a808-77cb5c825c8b service nova] Creating event network-vif-deleted:04c693b8-b0c5-4480-a278-08e6a78747c0 for instance ca634131-d896-451a-8213-b55471341fa6 on hv-cinder-84684 Jun 24 04:24:28.925964 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-914ad41b-ad33-4fdb-b43c-eed6fd898b6a req-2acf23bb-3680-41e5-a808-77cb5c825c8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Jun 24 04:24:28.926608 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 531/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:29.855185 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:29.855798 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:29.863043 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.863648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.864534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.865137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.868364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:29.870998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:29.878958 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.889699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.889699 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.889914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.890023 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 HTTP/1.1 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:29.890120 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.891649 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570'} Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:29.892543 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.894860 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.898184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:29.898184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7c565b78-1348-4fd8-aba7-dcbbfff0a450 tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 404 len: 111 microversion: 2.1 time: 0.032674 Jun 24 04:24:29.898184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 555/1086] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:29 2022] DELETE /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:29.902426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:29.902426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] [instance: f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:29.913737 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.914178 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.915260 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.915892 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.931485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] HTTP exception thrown: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Request method failure captured: Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 HTTP/1.1 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTravjeOTO-LwtKQM511ND4PE70L7XogX8zM4NJl_05X_iHOD_OVIVlbT5qkDLrywGD953yK6GgbrQtGJ5LvlJPm94HTiB7La4cZgHaAkhLSWEiLkfjWDhoOEygG7TtZOG3Pl3czwed8F-nyqZ1Px3mm6kbDJouNLe9572ei-RuKT8c Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:29.933485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7130ecbc4d487db66baebeab8550b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7130ecbc4d487db66baebeab8550b0"}]}] Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ab7130ecbc4d487db66baebeab8550b0 Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1023694222 Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 114d227e9645409e9082cf9b09b05c3b Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeNegativeTest-1023694222-project Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.934944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570'} Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:29.935726 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. Jun 24 04:24:29.937051 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:29.939622 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] Returning 404 to user: Instance f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:29.941255 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-328b417f-5286-4212-91f6-f055e423489e tempest-AttachVolumeNegativeTest-1023694222 tempest-AttachVolumeNegativeTest-1023694222-project] 10.222.0.16 "GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570" status: 404 len: 111 microversion: 2.1 time: 0.047113 Jun 24 04:24:29.942217 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 556/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:29 2022] GET /compute/v2.1/servers/f8ed85e5-8f3c-4c12-a7b4-6dfa1c739570 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:29.963123 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:29.963560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:29.964823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lazy-loading 'fault' on Instance uuid ca634131-d896-451a-8213-b55471341fa6 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:29.970292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=100 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:30.014198 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066d1521db464b4996f6daf6548dcc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba92bd9c1afc47008582aba7ec0c5266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:30.022660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3312d5c3-9df4-4da8-9b69-260bd18808d8 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 200 len: 1328 microversion: 2.1 time: 0.159730 Jun 24 04:24:30.023427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 532/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:29 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:24:31.040501 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:31.041709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:31.048500 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:31.048949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:31.050976 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:31.051418 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:31.071779 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 HTTP/1.1 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:31.073466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:31.075511 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ca634131-d896-451a-8213-b55471341fa6'} Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:31.076684 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:31.077974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:31.080462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:31.080462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a1497723-76d3-4ffd-aab3-16f3ca721e46 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 404 len: 111 microversion: 2.1 time: 0.038563 Jun 24 04:24:31.080462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 557/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:31 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:31.095504 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7388d387-8c7c-4f51-afa0-dc508160e724 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '.version_select at 0x7fdfed18d9d0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:31.193153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7388d387-8c7c-4f51-afa0-dc508160e724 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728025458" status: 202 len: 0 microversion: 2.1 time: 0.112652 Jun 24 04:24:31.193920 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 533/1090] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jun 24 04:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728025458 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:24:36.822949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:36.823448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:36.830164 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:36.830659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:36.831540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:36.832593 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 HTTP/1.1 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:36.850777 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.852530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'ca634131-d896-451a-8213-b55471341fa6'} Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:36.853367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.854644 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.855882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:36.855882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-94907a75-80c7-4a1f-8018-1a1c8e3b6780 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 404 len: 111 microversion: 2.1 time: 0.032168 Jun 24 04:24:36.855882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 558/1091] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:36 2022] DELETE /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:36.860502 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:36.861417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: ca634131-d896-451a-8213-b55471341fa6] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:36.868032 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:36.868481 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:36.869248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:36.869688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:36.883633 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 HTTP/1.1 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:36.885300 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.886968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'ca634131-d896-451a-8213-b55471341fa6'} Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:36.887856 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. Jun 24 04:24:36.889328 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:36.891709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance ca634131-d896-451a-8213-b55471341fa6 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:36.891709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-75dbd38d-4fe0-4df5-86f9-ee996f5b4efa tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6" status: 404 len: 111 microversion: 2.1 time: 0.030954 Jun 24 04:24:36.891709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 534/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:36 2022] GET /compute/v2.1/servers/ca634131-d896-451a-8213-b55471341fa6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:37.304431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:37.314768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:37.314768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.314768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.314768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.315126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.343112 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e1e2dad8-e0b1-4a54-94b5-8df4f40759db tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043201 Jun 24 04:24:37.343668 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 559/1093] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jun 24 04:24:37 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:37.405233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:37.405694 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:37.411893 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.412325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.416154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.416154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.445467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:24:37.796966 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7c7c83bb-febc-4047-91b4-5c1b05d35085 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 204 len: 0 microversion: 2.20 time: 0.395326 Jun 24 04:24:37.797745 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 535/1094] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jun 24 04:24:37 2022] DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 04:24:37.807609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:37.808212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:37.815045 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.815495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.816579 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:37.817016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:37.970533 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:37.981542 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:37.983349 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:37.988289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f874ee5e-0a9e-429b-bb19-589708f059de tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.182587 Jun 24 04:24:37.988289 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 560/1095] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:37 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:38.236026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:38.236923 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:38.245155 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:38.252301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:38.252301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:38.252301 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:38.263044 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 HTTP/1.1 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:38.264776 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.266186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '95960fad-f7dd-4195-97e2-b8519a0ac2d3'} Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:38.266985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.268234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.269487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:38.269487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-412a6b61-b698-40ea-b798-2b0253ff3786 tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 404 len: 111 microversion: 2.1 time: 0.035049 Jun 24 04:24:38.269487 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 536/1096] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:38 2022] DELETE /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:38.276615 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:38.277230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] [instance: 95960fad-f7dd-4195-97e2-b8519a0ac2d3] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:38.283448 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:38.283894 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:38.284746 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:38.285091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:38.289387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:38.298619 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] HTTP exception thrown: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Request method failure captured: Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 HTTP/1.1 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrf2UT5P8Wd96bGyK6g7ZnoiGCRdmxp2S76OczlTFOlyHTXefwJZkertJ55QmCfuQ4wGh7rQSuGkGYIPcB8R8B18Q0Upv10Hv58liyod_TaFBLRwmKN5TUR_BjhzyELCJdNcnBhqMVOKAfc6c6MdpUh7ZQ5Xib2zymf4lEhreMSkA8 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:38.300133 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba92bd9c1afc47008582aba7ec0c5266"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba92bd9c1afc47008582aba7ec0c5266"}]}] Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: ba92bd9c1afc47008582aba7ec0c5266 Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-663119190 Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 066d1521db464b4996f6daf6548dcc38 Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeTestJSON-663119190-project Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.301560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '95960fad-f7dd-4195-97e2-b8519a0ac2d3'} Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:38.302445 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. Jun 24 04:24:38.303732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:38.304988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] Returning 404 to user: Instance 95960fad-f7dd-4195-97e2-b8519a0ac2d3 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:38.304988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b9abf0d0-eb3a-4c45-98ed-5070110a0c3f tempest-AttachVolumeTestJSON-663119190 tempest-AttachVolumeTestJSON-663119190-project] 10.222.0.16 "GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3" status: 404 len: 111 microversion: 2.1 time: 0.029753 Jun 24 04:24:38.304988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 561/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:38 2022] GET /compute/v2.1/servers/95960fad-f7dd-4195-97e2-b8519a0ac2d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:24:39.006435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:39.006435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:39.012221 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:39.012798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:39.013563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:39.014211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:39.242880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:39.252592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:39.254102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:39.255391 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-09224380-d359-4cbd-b36e-023193e4056f tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1719 microversion: 2.20 time: 0.255987 Jun 24 04:24:39.255946 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 537/1098] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:38 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1719 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:40.275460 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:40.276074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:40.283528 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:40.283975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:40.284751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:40.285278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:40.352475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:40.364508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:40.364508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:40.364508 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9dfa93a9-4926-45e4-9a6c-ad27a13f8e2e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1654 microversion: 2.20 time: 0.093301 Jun 24 04:24:40.365522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 562/1099] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:40 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:40.674981 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-0030b9a5-84f1-4c30-a845-4c3670a6c3b1 req-ab2ab015-7b89-4e5a-9f79-7b3ee8df8d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45", "name": "network-vif-deleted", "tag": "ab32d98a-bac7-43ac-9d49-8e1998c9fbc2"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:40.689021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-0030b9a5-84f1-4c30-a845-4c3670a6c3b1 req-ab2ab015-7b89-4e5a-9f79-7b3ee8df8d33 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:40.689923 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-0030b9a5-84f1-4c30-a845-4c3670a6c3b1 req-ab2ab015-7b89-4e5a-9f79-7b3ee8df8d33 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:40.703394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-0030b9a5-84f1-4c30-a845-4c3670a6c3b1 req-ab2ab015-7b89-4e5a-9f79-7b3ee8df8d33 service nova] Creating event network-vif-deleted:ab32d98a-bac7-43ac-9d49-8e1998c9fbc2 for instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 on hv-cinder-84684 Jun 24 04:24:40.729749 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-0030b9a5-84f1-4c30-a845-4c3670a6c3b1 req-ab2ab015-7b89-4e5a-9f79-7b3ee8df8d33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046758 Jun 24 04:24:40.731177 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 538/1100] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:41.386938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:41.387564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:41.404656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:41.405126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:41.407676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:41.408130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:41.476313 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:41.476947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:41.477540 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lazy-loading 'fault' on Instance uuid 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:24:41.573431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:41.593308 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:41.599101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ffa029a3b1e4919b00e58a9737816d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56eee171a5c4f728bec99eef1f3b0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:41.599101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4a4b79f6-17d3-46b2-8f28-c886ddf2f361 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 200 len: 1370 microversion: 2.20 time: 0.215965 Jun 24 04:24:41.599101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 563/1101] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:41 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 04:24:42.616604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:42.617209 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:42.624427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:42.624876 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:42.625637 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:42.626073 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:42.639913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 HTTP/1.1 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:42.641557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:42.643466 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45'} Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:42.644262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:42.645507 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:42.647475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:42.647475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2fc8bcb6-9f1f-4b37-87b9-ce9e1fcb16da tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 404 len: 111 microversion: 2.20 time: 0.031694 Jun 24 04:24:42.647475 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 539/1102] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:42 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:24:42.653771 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c0d3a920-fd60-44af-af0f-21e04fad55dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '.version_select at 0x7fdfed14faf0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:42.718095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c0d3a920-fd60-44af-af0f-21e04fad55dc tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445687131" status: 204 len: 0 microversion: 2.20 time: 0.068521 Jun 24 04:24:42.718901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 564/1103] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Jun 24 04:24:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445687131 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 04:24:45.930981 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:45.931751 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:45.940047 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:45.940485 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:45.941238 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:45.941907 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:45.955573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 HTTP/1.1 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:45.957122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:45.959491 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45'} Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:45.960596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:45.962153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:45.963781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:45.963781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-eb289537-e244-46b0-9949-c769f20c4b5e tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 404 len: 111 microversion: 2.20 time: 0.032080 Jun 24 04:24:45.963781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 540/1104] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jun 24 04:24:45 2022] DELETE /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:24:45.970904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:45.974611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:45.982010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:45.982890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:45.983663 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:45.984273 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:45.998645 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 HTTP/1.1 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:46.003031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:46.004695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45'} Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:46.005669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. Jun 24 04:24:46.007252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:46.008592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance 86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:46.008592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e9b9e38a-403a-480a-b1a5-dc70e22d20ef tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45" status: 404 len: 111 microversion: 2.20 time: 0.036219 Jun 24 04:24:46.008592 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 565/1105] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:45 2022] GET /compute/v2.1/servers/86ec0b9f-9bfa-447b-bb33-d30a7a6d2c45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:24:47.460640 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:47.461228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:47.477373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:47.477373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:47.477373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:47.477373 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:47.483818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b HTTP/1.1 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:24:47.485433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.487248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'b085e856-e8d0-451d-be61-532ea491655b'} Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:47.488184 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.490171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.492482 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:47.493323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-47e28fbd-0809-4cd6-936a-afd519fac918 tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 404 len: 111 microversion: 2.20 time: 0.037040 Jun 24 04:24:47.493869 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 541/1106] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jun 24 04:24:47 2022] DELETE /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:24:47.501904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:47.502698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] [instance: b085e856-e8d0-451d-be61-532ea491655b] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:47.510287 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:47.510995 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:47.511834 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:47.512322 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:47.527464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] HTTP exception thrown: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Request method failure captured: Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b HTTP/1.1 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTrZcf4W0CAlNzNVs4ugorTjUHdsulEBsDbweCL27hSIepAQ8Reexxo4d6a2beaWQQ4GuhxITLR0DFAFae76M7OaLJcHzsY2-2a7USCAFb1MV1AbFTgsJ3_miSQMedX7SdFuzL_d3ipC4m6Vih2t_hIsAMBr2TvJnHhNHmYFpKJpieU Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:24:47.529105 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d56eee171a5c4f728bec99eef1f3b0a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d56eee171a5c4f728bec99eef1f3b0a3"}]}] Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: d56eee171a5c4f728bec99eef1f3b0a3 Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-343343638 Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 9ffa029a3b1e4919b00e58a9737816d2 Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-343343638-project Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.530852 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'b085e856-e8d0-451d-be61-532ea491655b'} Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:24:47.531720 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. Jun 24 04:24:47.533234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:24:47.534588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] Returning 404 to user: Instance b085e856-e8d0-451d-be61-532ea491655b could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:24:47.534588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-55967337-4193-46a8-af5d-bcf64bed5a8a tempest-AttachVolumeShelveTestJSON-343343638 tempest-AttachVolumeShelveTestJSON-343343638-project] 10.222.0.16 "GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b" status: 404 len: 111 microversion: 2.20 time: 0.032398 Jun 24 04:24:47.534588 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 566/1107] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jun 24 04:24:47 2022] GET /compute/v2.1/servers/b085e856-e8d0-451d-be61-532ea491655b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 04:24:53.468381 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-96d612c4-cdae-4a97-875e-da5a87701e71 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Action: 'create', calling method: .version_select at 0x7fdfed1f0c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1162523265", "metadata": {"Type": "work"}}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:54.233644 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-96d612c4-cdae-4a97-875e-da5a87701e71 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.948467 Jun 24 04:24:54.234264 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 542/1108] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jun 24 04:24:53 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 950 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 04:24:54.245804 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3dbdefab-53fa-44f4-8997-96fb69cd2c8b tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed2203a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:54.295274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3dbdefab-53fa-44f4-8997-96fb69cd2c8b tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.053024 Jun 24 04:24:54.295848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 567/1109] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:54 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:55.308603 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5c682446-e471-4790-8083-074f44a3d259 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed1ca1f0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:55.360770 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5c682446-e471-4790-8083-074f44a3d259 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.057215 Jun 24 04:24:55.361347 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 543/1110] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:55 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:55.600527 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:55.603629 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:55.605910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-3e02a7c1-9272-43ff-8e92-f1538f2bd5d5 req-c20672bb-0aba-45e5-acad-23197586be9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:24:55.607506 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:55.609257 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:55.609947 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:55.610067 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:24:55.611234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:55.611902 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:55.616671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3e02a7c1-9272-43ff-8e92-f1538f2bd5d5 req-c20672bb-0aba-45e5-acad-23197586be9a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:55.617119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3e02a7c1-9272-43ff-8e92-f1538f2bd5d5 req-c20672bb-0aba-45e5-acad-23197586be9a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:55.629263 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-3e02a7c1-9272-43ff-8e92-f1538f2bd5d5 req-c20672bb-0aba-45e5-acad-23197586be9a service nova] Creating event network-changed:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:24:55.635665 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-3e02a7c1-9272-43ff-8e92-f1538f2bd5d5 req-c20672bb-0aba-45e5-acad-23197586be9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033634 Jun 24 04:24:55.636279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 544/1111] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:55.642700 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:24:55.991683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2412be2b-6751-4598-a754-48cc03575e5c tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 204 len: 0 microversion: 2.1 time: 0.396017 Jun 24 04:24:55.992674 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 568/1112] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:24:55 2022] DELETE /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:24:56.001795 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:56.002779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:56.010248 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:56.010789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:56.011818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:56.012333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:56.175714 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:56.185388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-404c6bb9-5888-466e-880c-798db65ce30f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.187912 Jun 24 04:24:56.186364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 545/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:55 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:56.373730 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-3c0cd834-510f-4209-8ad6-b2cf078df94c tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed14f5e0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:56.456950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-3c0cd834-510f-4209-8ad6-b2cf078df94c tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.087645 Jun 24 04:24:56.457781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 569/1114] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:56 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:57.202899 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:57.203524 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:57.211287 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:57.211741 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:57.212510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:57.212968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:57.365933 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:57.373503 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d6683806-c48c-4af0-bfe8-3f0d990f7012 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.174436 Jun 24 04:24:57.374386 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 546/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:57 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:57.470017 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d49734a0-4463-4315-8b90-4a93c3d8f2dd tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed2fa3a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:57.518055 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d49734a0-4463-4315-8b90-4a93c3d8f2dd tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.052750 Jun 24 04:24:57.518658 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 570/1116] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:57 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:24:58.391117 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:58.391703 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:58.398283 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:58.398758 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:58.399515 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:58.400211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:58.531688 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-cefd9ad4-0238-4863-afaa-626eb1750723 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed14f280>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:58.540719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:58.548592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-66394f47-90bd-467e-a996-4524e8cb403b tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.161350 Jun 24 04:24:58.549259 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 547/1117] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:58 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:24:58.579212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-cefd9ad4-0238-4863-afaa-626eb1750723 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.051778 Jun 24 04:24:58.579787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 571/1118] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:58 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:59.566272 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:59.566909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:24:59.574178 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:59.574526 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:59.575290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:24:59.575717 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:24:59.592970 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7538017f-4c11-438e-8826-eec5aa4ed9cb tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed196f70>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:24:59.642459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7538017f-4c11-438e-8826-eec5aa4ed9cb tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.053795 Jun 24 04:24:59.643058 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 572/1119] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:24:59 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:24:59.714234 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:24:59.722091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-79eca95b-450a-420d-852c-51e027ea5102 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.159621 Jun 24 04:24:59.722765 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 548/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:24:59 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:00.655472 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a3bdffa7-0846-4a53-9286-6148fe67e940 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed16a4c0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:00.703228 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a3bdffa7-0846-4a53-9286-6148fe67e940 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.051956 Jun 24 04:25:00.703800 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 573/1121] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:00 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:25:00.739735 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:00.741442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:00.747711 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:00.748149 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:00.748904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:00.749365 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:00.887810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:00.895320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ccef120d-9262-4c9b-addd-358e98039cd8 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.159419 Jun 24 04:25:00.895864 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 549/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:00 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:01.717234 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a53f837e-eef9-4fc1-8145-f0c39110b5bf tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed1963a0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:01.773942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a53f837e-eef9-4fc1-8145-f0c39110b5bf tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.054649 Jun 24 04:25:01.773942 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 574/1123] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:01 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:25:01.914350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:01.915119 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:01.921756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:01.925367 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:01.926726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:01.926726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:01.931286 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:25:02.137908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:02.145504 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c39f4ec5-a6bf-4a60-91c9-17098008bfcb tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1569 microversion: 2.1 time: 0.236299 Jun 24 04:25:02.146052 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 550/1124] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:01 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:02.781491 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-b4726945-93d5-4d28-8ea5-f7ed685999a2 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdff1aba820>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:02.830362 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-b4726945-93d5-4d28-8ea5-f7ed685999a2 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 354 microversion: 2.1 time: 0.053142 Jun 24 04:25:02.831169 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 575/1125] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:02 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:25:02.845113 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ea4b8a04-b072-447d-81f6-db8f687e59f8 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed1dd5e0>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:02.898120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ea4b8a04-b072-447d-81f6-db8f687e59f8 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 354 microversion: 2.1 time: 0.056964 Jun 24 04:25:02.902419 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 551/1126] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:02 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:25:02.916473 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-070c8ccb-29fd-429d-9687-8fdd0599a22d tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed2fa820>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:02.974065 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-8b657873-edec-41f8-b52c-e3bc6244b65e req-f72edcb5-4d46-4560-885d-b2233a4c5e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29140f43-38c3-47c1-84f2-0181cb18e153", "name": "network-vif-deleted", "tag": "74725fba-5aba-4db8-8543-5b3c9241a5a6"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:25:02.983223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8b657873-edec-41f8-b52c-e3bc6244b65e req-f72edcb5-4d46-4560-885d-b2233a4c5e96 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:02.983667 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8b657873-edec-41f8-b52c-e3bc6244b65e req-f72edcb5-4d46-4560-885d-b2233a4c5e96 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:02.995871 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-8b657873-edec-41f8-b52c-e3bc6244b65e req-f72edcb5-4d46-4560-885d-b2233a4c5e96 service nova] Creating event network-vif-deleted:74725fba-5aba-4db8-8543-5b3c9241a5a6 for instance 29140f43-38c3-47c1-84f2-0181cb18e153 on hv-cinder-84684 Jun 24 04:25:03.001974 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-8b657873-edec-41f8-b52c-e3bc6244b65e req-f72edcb5-4d46-4560-885d-b2233a4c5e96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Jun 24 04:25:03.003153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 552/1127] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:25:03.167532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:03.168366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:03.169604 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-070c8ccb-29fd-429d-9687-8fdd0599a22d tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 202 len: 0 microversion: 2.1 time: 0.256869 Jun 24 04:25:03.171057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 576/1128] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jun 24 04:25:02 2022] DELETE /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:25:03.179782 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ea0de0f8-8c62-4968-a74d-74d0304360bb tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfee702b80>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:03.186638 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:03.187092 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:03.188088 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:03.188525 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:03.266115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:03.275350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-7781e7dd-baca-42ad-9644-f5f55c5a65ce tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1219 microversion: 2.1 time: 0.113470 Jun 24 04:25:03.276317 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 553/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:03 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:25:03.448304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ea0de0f8-8c62-4968-a74d-74d0304360bb tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 200 len: 353 microversion: 2.1 time: 0.273242 Jun 24 04:25:03.450106 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 577/1130] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:03 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 04:25:04.292692 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:04.293320 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:04.307081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:04.307081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:04.307081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:04.307081 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:04.331852 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:04.332299 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:04.332904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lazy-loading 'fault' on Instance uuid 29140f43-38c3-47c1-84f2-0181cb18e153 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:25:04.378399 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:04.386653 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-756af94e-5782-4456-bf6c-c5525d91b74f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1224 microversion: 2.1 time: 0.097806 Jun 24 04:25:04.387246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 554/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:04 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:04.466796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4990811-fa2f-46d1-a2be-aa1edf4c5684 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Calling method '.version_select at 0x7fdfed196550>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:04.496433 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-a4990811-fa2f-46d1-a2be-aa1edf4c5684 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] HTTP exception thrown: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4990811-fa2f-46d1-a2be-aa1edf4c5684 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Request method failure captured: Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 HTTP/1.1 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTyV4ADTwbj7VL3Zt6DOeG7e_6OFuSdNloPMcrB9yBnppXDCGjyr9M2LHs-WTiEOEo_l1-Xp4bdIM-Jcb5zUnnoTVntmXcNbrF1jmsxOYy5JinxcdwzgZXoqa7duLZWroGhohYCQfciz38_2FwgFz8umIESk74-k04Rg3a_2Efncgs8 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: 106010db0a25438092fc802cffb34384 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-VolumesGetTestJSON-1575248876 Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:25:04.498466 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/106010db0a25438092fc802cffb34384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/106010db0a25438092fc802cffb34384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/106010db0a25438092fc802cffb34384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_106010db0a25438092fc802cffb34384"}]}] Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-VolumesGetTestJSON-1575248876 Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: 106010db0a25438092fc802cffb34384 Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-VolumesGetTestJSON-1575248876 Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-VolumesGetTestJSON-1575248876-project Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: 388b53a8e7c5418da6ce8b9a55b7dae0 Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-VolumesGetTestJSON-1575248876-project Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': '4a590b29-6362-4aaa-88ba-c492042d9968'} Jun 24 04:25:04.507906 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. (HTTP 404) (Request-ID: req-be3f3b52-8eb9-44b8-a935-ae46871334f0) Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:25:04.509891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 04:25:04.511420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 04:25:04.512890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a4990811-fa2f-46d1-a2be-aa1edf4c5684 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] Returning 404 to user: Volume 4a590b29-6362-4aaa-88ba-c492042d9968 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a4990811-fa2f-46d1-a2be-aa1edf4c5684 tempest-VolumesGetTestJSON-1575248876 tempest-VolumesGetTestJSON-1575248876-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968" status: 404 len: 109 microversion: 2.1 time: 0.037542 Jun 24 04:25:04.514315 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 578/1132] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jun 24 04:25:04 2022] GET /compute/v2.1/os-volumes/4a590b29-6362-4aaa-88ba-c492042d9968 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:25:05.405610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:05.407163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:05.417415 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:05.420899 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:05.420899 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:05.420899 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:05.459816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:05.460276 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:05.460733 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lazy-loading 'fault' on Instance uuid 29140f43-38c3-47c1-84f2-0181cb18e153 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:25:05.506660 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:05.514442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-685cf13d-be8d-47a5-a229-91191d92bfc3 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1224 microversion: 2.1 time: 0.113712 Jun 24 04:25:05.524528 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 555/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:05 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:06.529549 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:25:06.533438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:06.534304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:06.541312 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:06.541758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:06.542565 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:06.543008 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:06.579749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:06.580201 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:06.580652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lazy-loading 'fault' on Instance uuid 29140f43-38c3-47c1-84f2-0181cb18e153 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:25:06.625961 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3821e46c09b449d85c46c58d99bf607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e75e404ef4f4118a95ca8fb8d98becd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:25:06.638336 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-7c3600e1-422d-4a2c-a982-574d07a45ae6 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 200 len: 1224 microversion: 2.1 time: 0.110537 Jun 24 04:25:06.639332 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 579/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:06 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:25:07.655939 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:07.656557 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] [instance: 29140f43-38c3-47c1-84f2-0181cb18e153] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:25:07.664401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:07.665005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:07.665848 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:25:07.666349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:25:07.686063 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] HTTP exception thrown: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Request method failure captured: Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 HTTP/1.1 Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTs2Z4c3q63pMKAHWz0JyTUJ7qxiAMG59sZ-WKXbaypIj8MeQEIReIAAwUQGHlQ6lA0U8Yu1M4az6NUYiEfRE68HTAvPbJlkvtITXc3JzuzPJrU9fI5m-QVQko_DBB6mGTqQR_vZgIEM-vGUn-Qd8BlFmGJHgBc88X3ZiyzaExKsrRc Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 7e75e404ef4f4118a95ca8fb8d98becd Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestShelveInstance-106802817 Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:25:07.687756 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e75e404ef4f4118a95ca8fb8d98becd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e75e404ef4f4118a95ca8fb8d98becd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e75e404ef4f4118a95ca8fb8d98becd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e75e404ef4f4118a95ca8fb8d98becd"}]}] Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestShelveInstance-106802817 Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 7e75e404ef4f4118a95ca8fb8d98becd Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestShelveInstance-106802817 Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestShelveInstance-106802817-project Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: f3821e46c09b449d85c46c58d99bf607 Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestShelveInstance-106802817-project Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. Jun 24 04:25:07.689359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '29140f43-38c3-47c1-84f2-0181cb18e153'} Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:25:07.690836 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. Jun 24 04:25:07.692377 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:25:07.696030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Returning 404 to user: Instance 29140f43-38c3-47c1-84f2-0181cb18e153 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:25:07.696030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-910b868b-6cf7-4b7e-a0f2-4ea5c58b669f tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153" status: 404 len: 111 microversion: 2.1 time: 0.038088 Jun 24 04:25:07.696030 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 556/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:25:07 2022] GET /compute/v2.1/servers/29140f43-38c3-47c1-84f2-0181cb18e153 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:25:07.968101 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-02df5299-180d-4dab-b5cf-84f63670ddf4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] Calling method '.version_select at 0x7fdfed15a040>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:25:08.047338 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-02df5299-180d-4dab-b5cf-84f63670ddf4 tempest-TestShelveInstance-106802817 tempest-TestShelveInstance-106802817-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-158798097" status: 202 len: 0 microversion: 2.1 time: 0.082982 Jun 24 04:25:08.048368 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 580/1136] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jun 24 04:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-158798097 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:25:54.643810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:25:54.644413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:25:58.891318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:25:58.891791 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:25:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:26:46.644412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=27 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:26:46.645341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=31 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:26:46.649104 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:46.649602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:46.656262 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:46.665631 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:46.665631 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:46.665631 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:46.682510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:26:46.908445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-f5bfadec-1337-42ab-b90a-84baa668b70b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 204 len: 0 microversion: 2.1 time: 0.265503 Jun 24 04:26:46.908950 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 557/1137] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:26:46 2022] DELETE /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 04:26:46.915047 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:26:46.915789 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=8 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:26:46.921027 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:46.921631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:46.927696 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:46.928141 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:46.930751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:46.930751 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:47.059485 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:47.067881 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e721d50f-8a53-45d3-b636-7b8e63e81fcb tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1576 microversion: 2.1 time: 0.154790 Jun 24 04:26:47.068431 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 581/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:46 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:48.086787 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:48.087508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:48.094867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:48.095311 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:48.096102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:48.096531 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:48.227273 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:48.234885 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-982d2259-2af9-4897-9486-23d64c7c507e tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1576 microversion: 2.1 time: 0.152352 Jun 24 04:26:48.235435 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 558/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:48 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:49.252384 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:49.252993 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:49.259458 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:49.259904 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:49.260693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:49.261095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:49.399344 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:49.407194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f71e3a40-1c43-42b4-9217-20f98de8a098 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1576 microversion: 2.1 time: 0.159250 Jun 24 04:26:49.407754 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 582/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:49 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:50.029017 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-8a21ebc0-9d44-4724-823b-f1a3ff8fc8c8 req-db9ca58b-1607-40fc-ac71-66b8b44c7b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0901d6-f9f8-423b-872f-c51e28ede6a9", "name": "network-vif-deleted", "tag": "fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:26:50.037903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8a21ebc0-9d44-4724-823b-f1a3ff8fc8c8 req-db9ca58b-1607-40fc-ac71-66b8b44c7b3a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:50.038325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8a21ebc0-9d44-4724-823b-f1a3ff8fc8c8 req-db9ca58b-1607-40fc-ac71-66b8b44c7b3a service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:50.050390 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-8a21ebc0-9d44-4724-823b-f1a3ff8fc8c8 req-db9ca58b-1607-40fc-ac71-66b8b44c7b3a service nova] Creating event network-vif-deleted:fdfe39bc-24eb-4e2c-9746-fd4e5ce80b24 for instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 on hv-cinder-84684 Jun 24 04:26:50.055430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-8a21ebc0-9d44-4724-823b-f1a3ff8fc8c8 req-db9ca58b-1607-40fc-ac71-66b8b44c7b3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031593 Jun 24 04:26:50.056021 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 559/1141] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:26:50.425652 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:50.450787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:50.450787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:50.450787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:50.450787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:50.452683 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:50.513669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:50.522248 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d3366599-554c-4eaf-9a8e-7ee6dcf99b5b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 200 len: 1224 microversion: 2.1 time: 0.101403 Jun 24 04:26:50.522873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 583/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:50 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:26:51.547211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:51.547923 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:51.554168 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:51.554655 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:51.555411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:51.555844 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:51.569897 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] HTTP exception thrown: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Request method failure captured: Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 HTTP/1.1 Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTwnPmVQExO4WtTmUj2frpETf0pE6aV_c7MRXACPiQ5DbJh6ai_oeNS2hcOUl8M59_LK8UxOM68-vRKBQM6lgKWn817mfnGu29Filt_v_pHEsk38UO6gEP5qwR4dihMjtusb-fpGXX6c-sZ6T--0RQyf9qey7J4MaTrVZRQSdIVrj8U Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:26:51.571592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9c12f0aa786483e8d1ce8ff9042164f"}]}] Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: d1cee676e3dc47e18e94de7e20b59455 Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:26:51.573188 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'fe0901d6-f9f8-423b-872f-c51e28ede6a9'} Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:26:51.574055 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:26:51.575443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:26:51.577157 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Returning 404 to user: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:26:51.577157 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-90a936ae-cef0-44a6-8001-1f71eb034cf0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 404 len: 111 microversion: 2.1 time: 0.031018 Jun 24 04:26:51.577157 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 560/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:51 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:26:51.669038 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-847326918", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716432859", "security_groups": [{"name": "tempest-secgroup-smoke-109829358"}], "block_device_mapping_v2": [{"uuid": "bc6e67c9-69bd-4cea-ad67-e86530a7f0c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a202b9e8-77c8-471b-bad0-c0f2e233e837"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:26:51.777922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] validate_networks() for [('a202b9e8-77c8-471b-bad0-c0f2e233e837', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:26:52.143787 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:26:52.144213 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:26:52.144719 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:26:52.145128 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:26:52.145547 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:26:52.154770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:52.155220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:52.156023 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:52.156459 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:52.172836 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:26:52.177170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for user d1cee676e3dc47e18e94de7e20b59455 and project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:26:52.234334 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:26:52.236488 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc6e67c9-69bd-4cea-ad67-e86530a7f0c6',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:26:52.666001 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-458ff6ed-f6af-4699-9814-00bf386e9a50 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.000729 Jun 24 04:26:52.666674 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 584/1144] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:26:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:26:52.677014 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5a8b4cc7-c901-48bf-9717-b1862b08beae tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:52.677625 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5a8b4cc7-c901-48bf-9717-b1862b08beae tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:52.737369 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5a8b4cc7-c901-48bf-9717-b1862b08beae tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:52.743202 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5a8b4cc7-c901-48bf-9717-b1862b08beae tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1093 microversion: 2.1 time: 0.069992 Jun 24 04:26:52.743909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 561/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:52 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:53.760212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:53.760806 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:53.768817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:53.769251 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:53.770012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:53.770481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:53.837194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:53.844817 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c226422a-4075-4180-ac1b-b89115140ba0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1143 microversion: 2.1 time: 0.089049 Jun 24 04:26:53.845373 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 585/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:53 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:54.860806 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:54.861420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:54.868709 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:54.869169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:54.870364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:54.870364 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:54.962522 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:54.972571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-84bc80ec-33cf-4241-a20b-3f37b7ec11d4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1209 microversion: 2.1 time: 0.115060 Jun 24 04:26:54.973598 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 562/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:54 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:55.991498 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:55.992091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:55.999425 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:56.001184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:56.001184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:56.001184 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:56.149339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:56.158076 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-00761f89-c147-4e88-8db9-670f1491a307 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1276 microversion: 2.1 time: 0.170423 Jun 24 04:26:56.158750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 586/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:55 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:56.381478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-8ea2a73b-e4df-4645-a4eb-8fecf178946a req-b3463d37-6c5c-404d-9c1e-49ee9944c3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4055b071-714c-42df-a252-68159d0f9020", "tag": "f85f217c-ad41-4b2e-a933-31e8c2468e20"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:26:56.396551 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8ea2a73b-e4df-4645-a4eb-8fecf178946a req-b3463d37-6c5c-404d-9c1e-49ee9944c3b5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:56.397256 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-8ea2a73b-e4df-4645-a4eb-8fecf178946a req-b3463d37-6c5c-404d-9c1e-49ee9944c3b5 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:56.419191 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-8ea2a73b-e4df-4645-a4eb-8fecf178946a req-b3463d37-6c5c-404d-9c1e-49ee9944c3b5 service nova] Creating event network-changed:f85f217c-ad41-4b2e-a933-31e8c2468e20 for instance 4055b071-714c-42df-a252-68159d0f9020 on hv-cinder-84684 Jun 24 04:26:56.426500 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-8ea2a73b-e4df-4645-a4eb-8fecf178946a req-b3463d37-6c5c-404d-9c1e-49ee9944c3b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048931 Jun 24 04:26:56.427579 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 563/1149] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:26:57.175599 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:57.176324 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:57.182880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:57.190825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:57.190825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:57.190825 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:57.330928 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:57.338597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-917de95a-5bda-4bf8-ba30-52dc8cf9c699 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.167114 Jun 24 04:26:57.339157 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 587/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:57 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:58.357647 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:58.358478 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:58.365646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:58.366102 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:58.366948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:58.367416 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:58.508740 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:58.517978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e77d31f6-6f20-4366-82c6-bde3248d337b tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.163607 Jun 24 04:26:58.517978 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 564/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:58 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:26:59.533490 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:26:59.534132 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:26:59.540570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:59.541010 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:59.541762 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:26:59.542196 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:26:59.676223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:26:59.683884 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-27798026-cbab-4e33-9fee-c21b94be25e8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.154779 Jun 24 04:26:59.684456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 588/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:26:59 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:00.702294 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:00.702934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:00.709111 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:00.709561 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:00.710319 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:00.710781 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:00.842115 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:00.849712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-5afe89eb-078b-40b1-9bf9-c3a1a894dce5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.152145 Jun 24 04:27:00.852206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 565/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:00 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:01.632922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040729208", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "networks": [{"uuid": "7c7526a9-fc19-4e2d-b4f0-f46b315eab12"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:01.683522 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] validate_networks() for [('7c7526a9-fc19-4e2d-b4f0-f46b315eab12', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:27:01.866327 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:01.866956 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:01.874574 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:01.880822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:01.880822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:01.880822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:02.013904 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:02.021619 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9c40cb88-8692-43a0-9feb-3dbf8fa0cf2a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.159215 Jun 24 04:27:02.022182 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 566/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:01 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:27:02.026461 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:27:02.026886 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:27:02.027358 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:27:02.027768 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:27:02.028181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:27:02.037304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:02.037773 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:02.038763 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:02.039202 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:02.055701 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Getting quotas for project 4a2dfcc0f1ad4daf8b26339e3eb51c53. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:27:02.059495 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Getting quotas for user fc82a6133e284d8e97a7a6f0a6c73f24 and project 4a2dfcc0f1ad4daf8b26339e3eb51c53. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:27:02.071187 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:27:02.073356 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:27:02.223467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-1e93845a-0ebb-48e0-aa0a-8cf4ca36b526 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594284 Jun 24 04:27:02.224118 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 589/1155] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:27:02.234486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-d0cfb0d6-2484-4795-9575-accde3875ce6 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:02.235077 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-d0cfb0d6-2484-4795-9575-accde3875ce6 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:02.287314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-d0cfb0d6-2484-4795-9575-accde3875ce6 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:02.294058 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-d0cfb0d6-2484-4795-9575-accde3875ce6 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1219 microversion: 2.1 time: 0.063905 Jun 24 04:27:02.295296 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 567/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:02 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:03.039235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:03.039848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:03.048912 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:03.055747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:03.055747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:03.055747 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:03.183585 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:03.191626 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-56c58668-4b5d-444a-b2d4-da84a2a8ec7a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.156734 Jun 24 04:27:03.192206 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 590/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:03 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:03.312000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:03.312610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:03.319902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:03.320350 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:03.321114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:03.321552 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:03.382233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:03.390937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-a089da6f-ebd5-4ec8-8c33-d1f8f5285111 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1223 microversion: 2.1 time: 0.083361 Jun 24 04:27:03.391480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 568/1158] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:03 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:04.208429 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:04.210481 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:04.216113 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:04.217226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:04.218078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:04.218550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:04.367277 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:04.376018 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-108d1626-a664-4b85-bc99-02e43a313c6c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.171448 Jun 24 04:27:04.376861 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 591/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:04 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:04.408822 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:04.409429 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:04.418340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:04.418340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:04.418340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:04.418340 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:04.502808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:04.512467 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-278011dc-c4c0-49da-9dc6-3811fcbfee32 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1279 microversion: 2.1 time: 0.108279 Jun 24 04:27:04.522486 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 569/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:04 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:05.392929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:05.393518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:05.399965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:05.400406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:05.401427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:05.401859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:05.531998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:05.532599 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:05.535864 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:05.539566 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:05.540074 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:05.541073 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:05.541571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:05.543439 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-f21f95fa-8e3e-4cc4-907d-b7a79fdb78c8 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.154412 Jun 24 04:27:05.544386 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 592/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:05 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:05.728508 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:05.736639 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1c59f227-2f67-4713-8687-14fda08c6325 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.209545 Jun 24 04:27:05.737145 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 570/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:05 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:27:06.016974 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-3b7200f2-6561-47aa-95a2-0c8b50ab73e4 req-1c893da4-905e-4877-948b-b2f2741a77e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6986b4fc-b532-4ce6-80c1-0f40cefb34da", "tag": "f798289d-0bb3-41dc-b7f8-a8535f97a872"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:06.025339 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3b7200f2-6561-47aa-95a2-0c8b50ab73e4 req-1c893da4-905e-4877-948b-b2f2741a77e6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.026035 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-3b7200f2-6561-47aa-95a2-0c8b50ab73e4 req-1c893da4-905e-4877-948b-b2f2741a77e6 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.037945 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-3b7200f2-6561-47aa-95a2-0c8b50ab73e4 req-1c893da4-905e-4877-948b-b2f2741a77e6 service nova] Creating event network-changed:f798289d-0bb3-41dc-b7f8-a8535f97a872 for instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da on hv-cinder-84684 Jun 24 04:27:06.042891 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-3b7200f2-6561-47aa-95a2-0c8b50ab73e4 req-1c893da4-905e-4877-948b-b2f2741a77e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030458 Jun 24 04:27:06.043499 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 593/1163] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:27:06.314909 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-3fc1dd9b-4115-405c-82b8-bdc98ad3d38b req-b11a884b-6999-41d4-b79f-63b625dde08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4055b071-714c-42df-a252-68159d0f9020", "name": "network-vif-plugged", "status": "completed", "tag": "f85f217c-ad41-4b2e-a933-31e8c2468e20"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:06.323445 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3fc1dd9b-4115-405c-82b8-bdc98ad3d38b req-b11a884b-6999-41d4-b79f-63b625dde08b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.323965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-3fc1dd9b-4115-405c-82b8-bdc98ad3d38b req-b11a884b-6999-41d4-b79f-63b625dde08b service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.337076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-3fc1dd9b-4115-405c-82b8-bdc98ad3d38b req-b11a884b-6999-41d4-b79f-63b625dde08b service nova] Creating event network-vif-plugged:f85f217c-ad41-4b2e-a933-31e8c2468e20 for instance 4055b071-714c-42df-a252-68159d0f9020 on hv-cinder-84684 Jun 24 04:27:06.343146 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-3fc1dd9b-4115-405c-82b8-bdc98ad3d38b req-b11a884b-6999-41d4-b79f-63b625dde08b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032885 Jun 24 04:27:06.343740 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 571/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:27:06.562693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:06.563391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:06.569577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.570179 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.570844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.571311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.713550 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:06.723601 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8c589aaa-ea7f-48bf-b30a-29d80e2c57c1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.166396 Jun 24 04:27:06.724175 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 594/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:06 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:06.754154 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:06.755141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:06.761228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.761815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.762604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:06.763571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:06.919859 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:06.927442 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-80acb63f-a1b1-4935-ad95-92d8042da9eb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.177942 Jun 24 04:27:06.927999 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 572/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:06 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:07.740693 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:07.741295 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:07.748744 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:07.749193 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:07.749944 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:07.750387 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:07.879674 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:07.887194 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-708f6fce-43ca-47b2-9d13-58d47c03c83a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.150419 Jun 24 04:27:07.887784 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 595/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:07 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:07.947280 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:07.948001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:07.955926 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:07.956689 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:07.957596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:07.958038 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:08.100767 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:08.108803 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-c6ce7098-5de0-4790-96ce-2af54c90e8f5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.167439 Jun 24 04:27:08.109363 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 573/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:07 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:08.905933 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:08.906555 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:08.913245 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:08.913682 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:08.914456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:08.914882 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:09.051880 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:09.059311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-20ee6c06-856e-4c20-9bc2-b61173da5412 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1264 microversion: 2.1 time: 0.157849 Jun 24 04:27:09.062404 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 596/1169] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:08 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:09.125388 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:09.125984 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:09.132174 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:09.132615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:09.133368 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:09.133796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:09.268602 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:09.277269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-749ab159-afda-4223-aa01-1feaaa8fbff2 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.156114 Jun 24 04:27:09.277865 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 574/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:09 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:10.076706 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:10.077318 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:10.083886 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.084335 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.085095 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.085532 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.214570 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:10.222284 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f71ac93-6bcf-46f4-a2b6-4642f82976f4 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1452 microversion: 2.1 time: 0.150238 Jun 24 04:27:10.222888 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 597/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:10 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:10.238443 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:10.239052 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:10.245339 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.245798 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.246617 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.247054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.293493 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:10.294167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:10.300278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.300724 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.301675 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:10.302074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:10.397511 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:10.406532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-41f4d5d5-dd14-498a-a726-a7764a831abf tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1452 microversion: 2.1 time: 0.171790 Jun 24 04:27:10.407112 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 575/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:10 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:10.453296 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:10.460887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2e7bf834-30e3-4a74-9dc4-5ce522a10495 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.171201 Jun 24 04:27:10.461464 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 598/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:10 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:27:11.477060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:11.478176 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:11.484381 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:11.484809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:11.485573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:11.486007 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:11.504394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:11.619091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:11.627880 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-36441633-aa1d-4e1e-a3a7-9f70831c2cb5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.154658 Jun 24 04:27:11.628535 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 576/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:11 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:12.251952 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-8933443f-0845-4f69-bd07-bfe19e451590 req-b3403bd1-1c1e-450d-898c-686283f01737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4055b071-714c-42df-a252-68159d0f9020", "tag": "f85f217c-ad41-4b2e-a933-31e8c2468e20"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:12.256172 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=4 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:12.256839 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=12 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:12.274717 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8933443f-0845-4f69-bd07-bfe19e451590 req-b3403bd1-1c1e-450d-898c-686283f01737 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:12.275154 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-8933443f-0845-4f69-bd07-bfe19e451590 req-b3403bd1-1c1e-450d-898c-686283f01737 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:12.288357 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-8933443f-0845-4f69-bd07-bfe19e451590 req-b3403bd1-1c1e-450d-898c-686283f01737 service nova] Creating event network-changed:f85f217c-ad41-4b2e-a933-31e8c2468e20 for instance 4055b071-714c-42df-a252-68159d0f9020 on hv-cinder-84684 Jun 24 04:27:12.294093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-8933443f-0845-4f69-bd07-bfe19e451590 req-b3403bd1-1c1e-450d-898c-686283f01737 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046573 Jun 24 04:27:12.294847 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 599/1175] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:27:12.493231 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-a51ec037-d8c1-4a1c-a3af-b314a19cb392 req-06086586-8ba1-4984-aefd-75aa880eb104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6986b4fc-b532-4ce6-80c1-0f40cefb34da", "name": "network-vif-plugged", "status": "completed", "tag": "f798289d-0bb3-41dc-b7f8-a8535f97a872"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:12.500492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=4 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:12.505269 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-a51ec037-d8c1-4a1c-a3af-b314a19cb392 req-06086586-8ba1-4984-aefd-75aa880eb104 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:12.505811 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-a51ec037-d8c1-4a1c-a3af-b314a19cb392 req-06086586-8ba1-4984-aefd-75aa880eb104 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:12.519175 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-a51ec037-d8c1-4a1c-a3af-b314a19cb392 req-06086586-8ba1-4984-aefd-75aa880eb104 service nova] Creating event network-vif-plugged:f798289d-0bb3-41dc-b7f8-a8535f97a872 for instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da on hv-cinder-84684 Jun 24 04:27:12.526165 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-a51ec037-d8c1-4a1c-a3af-b314a19cb392 req-06086586-8ba1-4984-aefd-75aa880eb104 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037539 Jun 24 04:27:12.527084 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 577/1176] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:27:12.647078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:12.647853 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:12.655669 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:12.656276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:12.657161 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:12.657687 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:12.662901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=100 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:12.828165 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:12.836689 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-92a26ed8-bfb0-49cc-8eab-de31cdf3e567 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.195038 Jun 24 04:27:12.837341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 600/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:12 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:13.854782 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:13.855474 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:13.862220 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:13.862628 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:13.863411 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:13.863841 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:13.995361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:14.003723 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-b59e2329-69f2-4ed2-8d1f-de0634cf8744 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1319 microversion: 2.1 time: 0.153660 Jun 24 04:27:14.004274 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 578/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:13 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:15.020607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:15.021145 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:15.027930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:15.028948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:15.029722 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:15.030153 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:15.271253 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:15.279406 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2f5c8ee4-4ba6-46cf-b725-bc5e276c5970 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1507 microversion: 2.1 time: 0.262802 Jun 24 04:27:15.279971 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 601/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:15 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:30.381375 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:27:30.386282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:27:30.564714 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b605c152-b5aa-48e7-a105-42b704a3fdbc] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 24 04:27:30.570129 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76a9b272-faff-4753-8993-d5b207a1796e", "device": "/dev/sdb"}} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:27:30.570649 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:30.572685 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:30.573401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=10 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:30.578114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:30.578671 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:30.579437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:30.579874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:31.572480 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] [b605c152-b5aa-48e7-a105-42b704a3fdbc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57530. Jun 24 04:27:32.047626 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-59701018-2a67-4e53-af16-86ee167ee4a8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "POST /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.484078 Jun 24 04:27:32.048228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 579/1180] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:27:30 2022] POST /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da/os-volume_attachments => generated 194 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:27:45.349366 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:27:45.350000 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:27:56.818292 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:56.818950 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:56.821203 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:56.821859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=10 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:56.826735 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:56.827181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:56.827941 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:56.828374 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:56.908930 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lazy-loading 'services' on Instance uuid 6986b4fc-b532-4ce6-80c1-0f40cefb34da {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:27:57.122701 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-09734c2a-d227-48d9-afd7-f1e447f34720 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da/os-volume_attachments/76a9b272-faff-4753-8993-d5b207a1796e" status: 202 len: 0 microversion: 2.1 time: 0.308412 Jun 24 04:27:57.123326 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 602/1181] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:27:56 2022] DELETE /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da/os-volume_attachments/76a9b272-faff-4753-8993-d5b207a1796e => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:27:58.238345 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:58.239780 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:27:58.243828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:58.244394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:58.250447 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:58.250898 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:58.251657 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:58.252141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:58.277719 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:27:58.666849 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ac14237c-bc43-4185-b500-f3c63977379f tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 204 len: 0 microversion: 2.1 time: 0.429602 Jun 24 04:27:58.667428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 580/1182] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:27:58 2022] DELETE /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 04:27:58.677410 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:58.678223 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:58.684685 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:58.685126 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:58.685948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:58.686394 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:58.814554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:58.822049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-dfd47dd6-5551-483e-8dad-614e06f63842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1513 microversion: 2.1 time: 0.150002 Jun 24 04:27:58.822637 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 603/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:58 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:27:59.840008 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:27:59.840700 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:27:59.847159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:59.847600 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:59.848422 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:27:59.848934 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:27:59.979769 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:27:59.987308 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-be773b8b-e741-4c44-9e88-cddb7d4fbf3c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1513 microversion: 2.1 time: 0.151558 Jun 24 04:27:59.987867 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 581/1184] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:27:59 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:01.005507 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:01.006220 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:01.012759 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:01.013305 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:01.014061 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:01.014518 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:01.148420 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:01.156905 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ac9db578-9e2b-4361-83af-b91ecb70f9c7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1513 microversion: 2.1 time: 0.155818 Jun 24 04:28:01.159873 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 604/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:00 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:01.339138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-5e86ade7-65da-4167-b82f-f7ceb9ee522b req-87622b69-be75-48d5-a48a-3027da451f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6986b4fc-b532-4ce6-80c1-0f40cefb34da", "name": "network-vif-deleted", "tag": "f798289d-0bb3-41dc-b7f8-a8535f97a872"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:01.347354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-5e86ade7-65da-4167-b82f-f7ceb9ee522b req-87622b69-be75-48d5-a48a-3027da451f83 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:01.347796 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-5e86ade7-65da-4167-b82f-f7ceb9ee522b req-87622b69-be75-48d5-a48a-3027da451f83 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:01.359120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-5e86ade7-65da-4167-b82f-f7ceb9ee522b req-87622b69-be75-48d5-a48a-3027da451f83 service nova] Creating event network-vif-deleted:f798289d-0bb3-41dc-b7f8-a8535f97a872 for instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da on hv-cinder-84684 Jun 24 04:28:01.364490 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-5e86ade7-65da-4167-b82f-f7ceb9ee522b req-87622b69-be75-48d5-a48a-3027da451f83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086177 Jun 24 04:28:01.365074 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 582/1186] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:28:02.173348 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:02.174174 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:02.180821 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:02.181271 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:02.182029 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:02.182484 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:02.213639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:02.214077 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:02.214554 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lazy-loading 'fault' on Instance uuid 6986b4fc-b532-4ce6-80c1-0f40cefb34da {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:28:02.257975 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:02.265007 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-c9bb8e7d-7eea-4322-81a4-223d9f637795 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 200 len: 1309 microversion: 2.1 time: 0.095627 Jun 24 04:28:02.265558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 605/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:02 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:03.284788 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:03.285479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: 6986b4fc-b532-4ce6-80c1-0f40cefb34da] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:03.292208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:03.292651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:03.293453 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:03.293834 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:03.307570 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] HTTP exception thrown: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Request method failure captured: Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da HTTP/1.1 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitT0T4DJTNjOPK7V1m6aUVUkgzd3rE0EMVPlLtXqqzzx1B-7gcSOjsDgGUlDu733Jga3Y2weaCcyOqYfZwxd6MDfNN8WNc2h6sXG0KbDs_VGa8LZNL2T_o7GLdGtbrTu6dOZryk-ZU9ZtUYe7ol9eHprL3YDFZyGaz_Tt7Khmc8IyZW4 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 4a2dfcc0f1ad4daf8b26339e3eb51c53 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:28:03.309201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}] Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 4a2dfcc0f1ad4daf8b26339e3eb51c53 Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesSnapshotTestJSON-2116580404-project Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: fc82a6133e284d8e97a7a6f0a6c73f24 Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesSnapshotTestJSON-2116580404-project Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. Jun 24 04:28:03.311025 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '6986b4fc-b532-4ce6-80c1-0f40cefb34da'} Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:28:03.312076 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. Jun 24 04:28:03.313695 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:03.315290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Returning 404 to user: Instance 6986b4fc-b532-4ce6-80c1-0f40cefb34da could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:28:03.315290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-6e38dec5-42d8-4c0b-ae49-7e710194dcf5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da" status: 404 len: 111 microversion: 2.1 time: 0.030561 Jun 24 04:28:03.315290 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 583/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:03 2022] GET /compute/v2.1/servers/6986b4fc-b532-4ce6-80c1-0f40cefb34da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:28:13.665198 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1090003101", "imageRef": "7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1", "flavorRef": "452", "networks": [{"uuid": "7c7526a9-fc19-4e2d-b4f0-f46b315eab12"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:13.672428 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=10 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:13.673106 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:13.718642 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] validate_networks() for [('7c7526a9-fc19-4e2d-b4f0-f46b315eab12', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:28:14.329655 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:28:14.330078 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:28:14.330603 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:28:14.331016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:28:14.331430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:28:14.340812 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:14.341261 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:14.342064 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:14.342539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:14.360226 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Getting quotas for project 4a2dfcc0f1ad4daf8b26339e3eb51c53. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:28:14.365092 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Getting quotas for user fc82a6133e284d8e97a7a6f0a6c73f24 and project 4a2dfcc0f1ad4daf8b26339e3eb51c53. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:28:14.376075 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:28:14.378285 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b95818b-e9e8-4682-a6c7-6e4a0a8a71a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:28:14.491057 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-a643e57a-83a9-4355-a392-628b2e779b37 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829580 Jun 24 04:28:14.491623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 606/1189] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:28:14.501589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1e804ef7-c1d0-4789-8709-4e369a301123 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:14.502228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1e804ef7-c1d0-4789-8709-4e369a301123 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:14.504919 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:14.505589 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:14.557690 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1e804ef7-c1d0-4789-8709-4e369a301123 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:14.566026 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1e804ef7-c1d0-4789-8709-4e369a301123 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1219 microversion: 2.1 time: 0.068237 Jun 24 04:28:14.566810 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 584/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:14 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:15.583048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:15.584325 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:15.591692 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:15.592131 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:15.593293 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:15.593732 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:15.655856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:15.663341 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-58002c7e-ee61-4a97-be77-257479041002 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1223 microversion: 2.1 time: 0.084726 Jun 24 04:28:15.663901 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 607/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:15 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:28:16.681609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:16.682341 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:16.689792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:16.690323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:16.691138 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:16.691572 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:16.769459 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:16.779153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1476f484-733d-4128-a1cb-33261dcc6d76 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1289 microversion: 2.1 time: 0.102434 Jun 24 04:28:16.780075 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 585/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:16 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:17.797215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:17.797848 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:17.805316 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:17.805758 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:17.806611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:17.807044 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:17.945544 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:17.953195 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-29fe3346-6ec4-4a43-9a48-d8ce142f7ebc tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.159931 Jun 24 04:28:17.953757 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 608/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:17 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:18.165797 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-fe168b34-8195-40d7-a798-5c2b63cbc643 req-ae77a2a4-de9c-455c-8831-533db22c4eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79c33cb-b5fb-4756-b7e4-c2360ff36055", "tag": "76049af4-1540-4b7b-92b1-7f8fd979a2d5"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:18.174573 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-fe168b34-8195-40d7-a798-5c2b63cbc643 req-ae77a2a4-de9c-455c-8831-533db22c4eca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:18.175020 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-fe168b34-8195-40d7-a798-5c2b63cbc643 req-ae77a2a4-de9c-455c-8831-533db22c4eca service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:18.189816 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-fe168b34-8195-40d7-a798-5c2b63cbc643 req-ae77a2a4-de9c-455c-8831-533db22c4eca service nova] Creating event network-changed:76049af4-1540-4b7b-92b1-7f8fd979a2d5 for instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 on hv-cinder-84684 Jun 24 04:28:18.195541 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-fe168b34-8195-40d7-a798-5c2b63cbc643 req-ae77a2a4-de9c-455c-8831-533db22c4eca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034613 Jun 24 04:28:18.204091 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 586/1194] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:28:18.971219 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:18.971796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:18.978922 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:18.979367 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:18.980130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:18.980558 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:19.112276 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:19.120206 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-52b8c4c3-6b04-4e35-90db-a54d2b315542 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.153087 Jun 24 04:28:19.120769 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 609/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:18 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:20.137380 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:20.138080 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:20.144763 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:20.145211 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:20.146506 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:20.146948 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:20.279056 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:20.286333 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9b5a00a7-e0ab-4950-a333-378fdb15fdd5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.153187 Jun 24 04:28:20.287583 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 587/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:20 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:21.303438 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:21.304015 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:21.310397 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:21.310850 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:21.311602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:21.312034 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:21.445081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:21.452355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-2cf4ba0a-b3dd-4948-8314-6240df7fcaeb tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.153554 Jun 24 04:28:21.452908 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 610/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:21 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:22.477201 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:22.477808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:22.484354 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:22.484802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:22.485558 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:22.485993 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:22.625530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:22.633651 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-37b4385a-1dae-4118-a8a4-9f75437b3e57 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.160933 Jun 24 04:28:22.634208 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 588/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:22 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:22.862307 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-973a0e23-68d2-46e3-8d1e-e7641d86023d req-0ae6f911-4226-4077-88e2-8614eaa925b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79c33cb-b5fb-4756-b7e4-c2360ff36055", "name": "network-vif-plugged", "status": "completed", "tag": "76049af4-1540-4b7b-92b1-7f8fd979a2d5"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:22.871033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-973a0e23-68d2-46e3-8d1e-e7641d86023d req-0ae6f911-4226-4077-88e2-8614eaa925b1 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:22.871468 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-973a0e23-68d2-46e3-8d1e-e7641d86023d req-0ae6f911-4226-4077-88e2-8614eaa925b1 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:22.884600 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-973a0e23-68d2-46e3-8d1e-e7641d86023d req-0ae6f911-4226-4077-88e2-8614eaa925b1 service nova] Creating event network-vif-plugged:76049af4-1540-4b7b-92b1-7f8fd979a2d5 for instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 on hv-cinder-84684 Jun 24 04:28:22.891903 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-973a0e23-68d2-46e3-8d1e-e7641d86023d req-0ae6f911-4226-4077-88e2-8614eaa925b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092303 Jun 24 04:28:22.891903 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 611/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:28:23.651571 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:23.652233 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:23.658679 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:23.659124 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:23.659884 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:23.660316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:23.788196 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:23.795609 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-fc8da822-c468-4e23-80e6-9d5fdb376c5b tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.148127 Jun 24 04:28:23.796180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 589/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:23 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:24.814012 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:24.814653 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:24.816781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:24.817462 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:24.823303 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:24.828033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:24.828033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:24.828033 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:24.958138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:24.966207 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8de20e45-822f-4c07-be2a-d135745252f8 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1319 microversion: 2.1 time: 0.156751 Jun 24 04:28:24.966801 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 612/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:24 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:25.983779 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:25.984361 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:25.986398 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:25.992752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:25.999284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:25.999284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:25.999284 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:26.125802 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:26.134330 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-e96ed608-5e2f-4eb7-bfce-7366d85e96b5 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1507 microversion: 2.1 time: 0.154357 Jun 24 04:28:26.134918 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 590/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:25 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:26.151285 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d3e1bb-7704-456f-841b-f219ce2717ed", "device": "/dev/sdb"}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:26.153167 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:26.159607 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:26.160056 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:26.160796 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:26.161230 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:26.967509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4612f8e6-8692-4d4e-bdc6-a7cf5fef6842 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "POST /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820452 Jun 24 04:28:26.968197 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 613/1203] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jun 24 04:28:26 2022] POST /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:28:46.915437 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:46.915968 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:46.917919 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=16 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:46.918646 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=32 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:46.923346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:46.923797 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:46.924560 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:46.924998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:47.006862 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.objects.instance [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lazy-loading 'services' on Instance uuid d79c33cb-b5fb-4756-b7e4-c2360ff36055 {{(pid=118330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:28:47.243237 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-571bee2d-56b9-44be-889e-ce53e6d09166 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055/os-volume_attachments/17d3e1bb-7704-456f-841b-f219ce2717ed" status: 202 len: 0 microversion: 2.1 time: 0.332278 Jun 24 04:28:47.243891 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 591/1204] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jun 24 04:28:46 2022] DELETE /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055/os-volume_attachments/17d3e1bb-7704-456f-841b-f219ce2717ed => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:28:48.352249 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:48.353028 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:28:48.356985 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:48.357577 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:48.363602 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:48.364054 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:48.365476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:48.365938 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:48.392486 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:28:48.648856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35b0a0a9-4ae3-4071-8402-b46b7198d8ad tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 204 len: 0 microversion: 2.1 time: 0.297949 Jun 24 04:28:48.649453 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 614/1205] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:28:48 2022] DELETE /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:28:48.658913 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:48.660998 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:48.665808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:48.666257 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:48.667089 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:48.667527 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:48.800412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:48.808604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-1de0f2f4-9b9b-4d61-87e3-d62ffee78022 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1513 microversion: 2.1 time: 0.154438 Jun 24 04:28:48.810540 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 592/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:48 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:49.825715 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:49.826473 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:49.833534 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:49.833988 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:49.834774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:49.835206 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:49.964414 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:49.971887 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-eeeb5e2d-9819-493c-8a52-667912b32bff tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1513 microversion: 2.1 time: 0.150435 Jun 24 04:28:49.972444 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 615/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:49 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:50.988376 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:50.988985 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:50.996278 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:50.996726 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:50.997492 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:50.997925 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:51.127316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:51.135279 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-646c2be2-dc37-4d90-ad2c-0390208f36ce tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1513 microversion: 2.1 time: 0.150754 Jun 24 04:28:51.135837 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 593/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:50 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:52.152192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:52.152795 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:52.159272 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:52.159709 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:52.160452 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:52.160875 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:52.293426 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:52.301119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-45763024-4b1a-4eea-b086-8ca949ab4f3d tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1513 microversion: 2.1 time: 0.153207 Jun 24 04:28:52.302204 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 616/1209] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:52 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:28:52.741543 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-6efc07ea-dc9d-42f3-ba7f-df43c4f7c557 req-e11fd2b6-2095-49e4-b528-610f2391a731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79c33cb-b5fb-4756-b7e4-c2360ff36055", "name": "network-vif-deleted", "tag": "76049af4-1540-4b7b-92b1-7f8fd979a2d5"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:52.749828 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-6efc07ea-dc9d-42f3-ba7f-df43c4f7c557 req-e11fd2b6-2095-49e4-b528-610f2391a731 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:52.750266 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-6efc07ea-dc9d-42f3-ba7f-df43c4f7c557 req-e11fd2b6-2095-49e4-b528-610f2391a731 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:52.762405 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-6efc07ea-dc9d-42f3-ba7f-df43c4f7c557 req-e11fd2b6-2095-49e4-b528-610f2391a731 service nova] Creating event network-vif-deleted:76049af4-1540-4b7b-92b1-7f8fd979a2d5 for instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 on hv-cinder-84684 Jun 24 04:28:52.767344 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-6efc07ea-dc9d-42f3-ba7f-df43c4f7c557 req-e11fd2b6-2095-49e4-b528-610f2391a731 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030095 Jun 24 04:28:52.767910 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 594/1210] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:28:53.321098 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:53.321770 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:53.329716 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:53.343430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:53.343430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:53.343430 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:53.367411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:53.367856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:53.368299 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lazy-loading 'fault' on Instance uuid d79c33cb-b5fb-4756-b7e4-c2360ff36055 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:28:53.412244 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc82a6133e284d8e97a7a6f0a6c73f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2dfcc0f1ad4daf8b26339e3eb51c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:53.420676 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-99d2267b-f465-4a68-97eb-f4e4cfb7571c tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 200 len: 1309 microversion: 2.1 time: 0.104834 Jun 24 04:28:53.421311 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 617/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:53 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:28:54.438232 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:54.438982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] [instance: d79c33cb-b5fb-4756-b7e4-c2360ff36055] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:54.445937 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:54.446401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:54.447159 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:54.447591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:54.460532 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] HTTP exception thrown: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Request method failure captured: Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 HTTP/1.1 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitT0T4DJTNjOPK7V1m6aUVUkgzd3rE0EMVPlLtXqqzzx1B-7gcSOjsDgGUlDu733Jga3Y2weaCcyOqYfZwxd6MDfNN8WNc2h6sXG0KbDs_VGa8LZNL2T_o7GLdGtbrTu6dOZryk-ZU9ZtUYe7ol9eHprL3YDFZyGaz_Tt7Khmc8IyZW4 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: 4a2dfcc0f1ad4daf8b26339e3eb51c53 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:28:54.462114 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a2dfcc0f1ad4daf8b26339e3eb51c53"}]}] Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: 4a2dfcc0f1ad4daf8b26339e3eb51c53 Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2116580404 Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-VolumesSnapshotTestJSON-2116580404-project Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: fc82a6133e284d8e97a7a6f0a6c73f24 Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-VolumesSnapshotTestJSON-2116580404-project Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. Jun 24 04:28:54.463982 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'd79c33cb-b5fb-4756-b7e4-c2360ff36055'} Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:28:54.465096 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. Jun 24 04:28:54.466772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:28:54.468295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] Returning 404 to user: Instance d79c33cb-b5fb-4756-b7e4-c2360ff36055 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:28:54.468295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-47c5edb6-ca14-466e-bca5-f37ce57d1cf7 tempest-VolumesSnapshotTestJSON-2116580404 tempest-VolumesSnapshotTestJSON-2116580404-project] 10.222.0.16 "GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055" status: 404 len: 111 microversion: 2.1 time: 0.030113 Jun 24 04:28:54.468295 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 595/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:54 2022] GET /compute/v2.1/servers/d79c33cb-b5fb-4756-b7e4-c2360ff36055 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:28:56.950235 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-288846424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716432859", "security_groups": [{"name": "tempest-secgroup-smoke-109829358"}], "block_device_mapping_v2": [{"uuid": "8f550539-4a5e-4fc9-bfcf-caf9e87c7beb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a202b9e8-77c8-471b-bad0-c0f2e233e837"}]}} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:28:57.062216 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.network.neutron [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] validate_networks() for [('a202b9e8-77c8-471b-bad0-c0f2e233e837', None, None, None, None, None)] {{(pid=118331) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 04:28:57.435385 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 04:28:57.437552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image limits 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 04:28:57.437552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Flavor pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 04:28:57.437552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Image pref 0:0:0 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 04:28:57.437552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.virt.hardware [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 04:28:57.447924 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:57.448576 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:57.450090 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:57.450436 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:57.467929 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 04:28:57.471967 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.quota [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Getting quotas for user d1cee676e3dc47e18e94de7e20b59455 and project f9c12f0aa786483e8d1ce8ff9042164f. Resources: {'instances', 'ram', 'cores'} {{(pid=118331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 04:28:57.539427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Going to run 1 instances... {{(pid=118331) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 04:28:57.539427 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f550539-4a5e-4fc9-bfcf-caf9e87c7beb',volume_size=None,volume_type=None)] {{(pid=118331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 04:28:57.897049 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ded10a71-f7f5-4696-a871-2593e5879aed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.950001 Jun 24 04:28:57.898215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 618/1213] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jun 24 04:28:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 04:28:57.908815 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-ea02bae4-47e3-4e4e-9f55-c39e4b1478c6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:57.909563 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-ea02bae4-47e3-4e4e-9f55-c39e4b1478c6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:57.967712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-ea02bae4-47e3-4e4e-9f55-c39e4b1478c6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:57.974394 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-ea02bae4-47e3-4e4e-9f55-c39e4b1478c6 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1093 microversion: 2.1 time: 0.069521 Jun 24 04:28:57.975018 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 596/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:57 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:28:58.992475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:28:58.993074 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:28:59.000264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:59.000611 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:59.001702 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:28:59.002139 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:28:59.067845 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:28:59.075509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e517607f-db4c-4db9-aa0a-290c90444acc tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1143 microversion: 2.1 time: 0.087598 Jun 24 04:28:59.076064 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 619/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:28:58 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:00.091808 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:00.092417 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:00.100066 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:00.100610 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:00.101359 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:00.101789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:00.160206 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:00.167613 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-59cf2ff1-a213-4027-80d2-1fefc6b127e3 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1143 microversion: 2.1 time: 0.079644 Jun 24 04:29:00.168170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 597/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:00 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:01.184779 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:01.185364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:01.192093 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:01.192539 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:01.194089 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:01.194584 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:01.254214 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:01.262564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-ca5e7b11-8238-4397-90ba-9afef1782c27 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1191 microversion: 2.1 time: 0.081617 Jun 24 04:29:01.263130 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 620/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:01 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:02.280352 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:02.280902 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:02.287514 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:02.288309 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:02.289099 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:02.289536 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:02.369251 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:02.376752 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-4f720b6b-3bbb-4529-98ca-0df3eec1dce7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1209 microversion: 2.1 time: 0.100909 Jun 24 04:29:02.377316 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 598/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:02 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:03.395859 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:03.396530 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:03.405053 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:03.405844 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:03.416467 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:03.417031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:03.569170 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:03.574548 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-5c5fb638-2f9a-4675-99c1-ce0e81d0e27a req-705c5628-4bd8-4788-b6aa-54215d03b93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44ae3ea-a3c3-49cc-8914-814c72ad0554", "tag": "83a55b30-ba60-47f7-8bb5-58f4abb3d9ac"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:29:03.575119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-8561f45f-df2b-494e-b1e4-f762038025ca tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1276 microversion: 2.1 time: 0.183714 Jun 24 04:29:03.584656 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 621/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:03 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:03.586225 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-5c5fb638-2f9a-4675-99c1-ce0e81d0e27a req-705c5628-4bd8-4788-b6aa-54215d03b93e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:03.586545 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-5c5fb638-2f9a-4675-99c1-ce0e81d0e27a req-705c5628-4bd8-4788-b6aa-54215d03b93e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:03.600215 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-5c5fb638-2f9a-4675-99c1-ce0e81d0e27a req-705c5628-4bd8-4788-b6aa-54215d03b93e service nova] Creating event network-changed:83a55b30-ba60-47f7-8bb5-58f4abb3d9ac for instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 on hv-cinder-84684 Jun 24 04:29:03.605288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-5c5fb638-2f9a-4675-99c1-ce0e81d0e27a req-705c5628-4bd8-4788-b6aa-54215d03b93e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034611 Jun 24 04:29:03.605992 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 599/1220] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:29:04.591552 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:04.592181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:04.598560 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:04.599304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:04.599896 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:04.600391 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:04.733088 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:04.740890 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e3dd64f5-22e7-4498-99f9-4ab51b6ba33c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.152973 Jun 24 04:29:04.742442 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 622/1221] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:04 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:05.758087 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:05.758818 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:05.765143 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:05.765591 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:05.766410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:05.766929 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:05.901495 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:05.909170 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-49b7b614-51d0-4bb0-8952-db8bb262ec21 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.155772 Jun 24 04:29:05.909724 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 600/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:05 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:06.927376 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:06.928304 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:06.934059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:06.934609 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:06.938476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:06.938476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:07.072581 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:07.080016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-9582fa89-2713-4ef6-a029-c52762d7ae16 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.156948 Jun 24 04:29:07.080582 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 623/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:06 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:08.096698 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:08.097315 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:08.100218 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell0:SELECT=2 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:29:08.105031 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:08.105469 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:08.106224 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:08.106682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:08.237766 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:08.245903 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0441aa7a-04e0-4ca3-83bd-25a5e18da0ed tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.153092 Jun 24 04:29:08.246488 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 601/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:08 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:09.261994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:09.262623 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:09.264548 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=2 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:29:09.265212 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell0:SELECT=6 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:29:09.270564 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:09.271760 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:09.282215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:09.282215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:09.403826 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:09.411215 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-35e50c20-2164-4d32-b618-08f8a2152a74 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.153020 Jun 24 04:29:09.411994 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 624/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:09 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:10.428107 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:10.428712 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:10.435242 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:10.435715 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:10.436471 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:10.436906 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:10.566292 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:10.573914 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-9ea9f43f-eee4-401c-90f6-db09fa7b0b96 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.149722 Jun 24 04:29:10.574502 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 602/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:10 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:11.589776 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:11.590302 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:11.596752 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:11.597190 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:11.597936 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:11.598364 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:11.732405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:11.740913 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-42eba94d-cda9-46cb-8785-a11125bef39c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.153953 Jun 24 04:29:11.741476 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 625/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:11 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:12.758049 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:12.758855 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:12.765789 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:12.766230 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:12.767200 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:12.767661 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:12.914060 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:12.921683 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-2347e127-2b91-4075-aa09-1d0602bde484 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.168339 Jun 24 04:29:12.922249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 603/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:12 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:12.936575 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-502713c4-68d0-446f-a226-5059aa463093 req-de35eb64-6798-4520-b633-5e13e0600ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44ae3ea-a3c3-49cc-8914-814c72ad0554", "name": "network-vif-plugged", "status": "completed", "tag": "83a55b30-ba60-47f7-8bb5-58f4abb3d9ac"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:29:12.946137 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-502713c4-68d0-446f-a226-5059aa463093 req-de35eb64-6798-4520-b633-5e13e0600ecb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:12.946597 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-502713c4-68d0-446f-a226-5059aa463093 req-de35eb64-6798-4520-b633-5e13e0600ecb service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:12.958893 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-502713c4-68d0-446f-a226-5059aa463093 req-de35eb64-6798-4520-b633-5e13e0600ecb service nova] Creating event network-vif-plugged:83a55b30-ba60-47f7-8bb5-58f4abb3d9ac for instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 on hv-cinder-84684 Jun 24 04:29:12.964972 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-502713c4-68d0-446f-a226-5059aa463093 req-de35eb64-6798-4520-b633-5e13e0600ecb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Jun 24 04:29:12.965096 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 626/1229] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:29:13.938682 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:13.939288 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:13.946153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:13.946620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:13.947372 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:13.947801 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:14.083930 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:14.092581 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-0389b2f1-41c0-44c7-a1ed-246fc725c9ea tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1264 microversion: 2.1 time: 0.157775 Jun 24 04:29:14.096375 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 604/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:13 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:14.651479 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:29:14.651961 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:29:15.111509 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:15.112192 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:15.119354 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:15.119835 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:15.124639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:15.124639 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:15.255526 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:15.263456 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6a01b6fe-1b33-47a8-9234-f5952fac2df7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1452 microversion: 2.1 time: 0.156842 Jun 24 04:29:15.264016 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 627/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:15 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:15.280413 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:29:15.281014 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:29:15.287462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:15.289596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:15.289596 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:15.289950 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:15.422403 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:29:15.429905 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-22697a28-f8a8-4316-b5ff-a1763549ccb9 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1452 microversion: 2.1 time: 0.153637 Jun 24 04:29:15.430473 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 605/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:29:15 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:29:17.766695 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-db38de14-47a2-4750-9a97-7fc0888582e2 req-8f476ff1-86ac-4ee3-8223-596b1a54dd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44ae3ea-a3c3-49cc-8914-814c72ad0554", "tag": "83a55b30-ba60-47f7-8bb5-58f4abb3d9ac"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:29:17.776517 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-db38de14-47a2-4750-9a97-7fc0888582e2 req-8f476ff1-86ac-4ee3-8223-596b1a54dd58 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:29:17.778361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-db38de14-47a2-4750-9a97-7fc0888582e2 req-8f476ff1-86ac-4ee3-8223-596b1a54dd58 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:29:17.789881 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-db38de14-47a2-4750-9a97-7fc0888582e2 req-8f476ff1-86ac-4ee3-8223-596b1a54dd58 service nova] Creating event network-changed:83a55b30-ba60-47f7-8bb5-58f4abb3d9ac for instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 on hv-cinder-84684 Jun 24 04:29:17.795048 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-db38de14-47a2-4750-9a97-7fc0888582e2 req-8f476ff1-86ac-4ee3-8223-596b1a54dd58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Jun 24 04:29:17.795648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 628/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:30:50.389119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:30:50.389738 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:30:57.815171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_api:SELECT=32 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:30:57.815171 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG dbcounter [-] [118330] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=118330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:30:57.819385 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d887a965-cffd-4919-8c33-2ab1f9dcab95] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 24 04:30:57.819858 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:30:57.820031 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:30:57.820186 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:30:57.821312 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG dbcounter [-] [118331] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:30:57.826678 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:57.831238 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:57.832163 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:57.832684 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:57.859462 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Going to try to terminate instance {{(pid=118330) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:30:58.019411 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-36050ecf-be06-45ef-a2fb-4a81ec1c948e req-8760fcdc-9c36-40e7-b329-3de2667c646e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44ae3ea-a3c3-49cc-8914-814c72ad0554", "tag": "83a55b30-ba60-47f7-8bb5-58f4abb3d9ac"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:30:58.028408 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-36050ecf-be06-45ef-a2fb-4a81ec1c948e req-8760fcdc-9c36-40e7-b329-3de2667c646e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:58.033135 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-36050ecf-be06-45ef-a2fb-4a81ec1c948e req-8760fcdc-9c36-40e7-b329-3de2667c646e service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:58.040382 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-36050ecf-be06-45ef-a2fb-4a81ec1c948e req-8760fcdc-9c36-40e7-b329-3de2667c646e service nova] Creating event network-changed:83a55b30-ba60-47f7-8bb5-58f4abb3d9ac for instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 on hv-cinder-84684 Jun 24 04:30:58.046264 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-36050ecf-be06-45ef-a2fb-4a81ec1c948e req-8760fcdc-9c36-40e7-b329-3de2667c646e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231977 Jun 24 04:30:58.046943 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 629/1234] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:30:58.172786 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-965b4958-32c7-4ffb-a38e-ece7f93ac2ab tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 204 len: 0 microversion: 2.1 time: 0.361290 Jun 24 04:30:58.179420 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 606/1235] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:30:57 2022] DELETE /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:30:58.186119 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:30:58.186997 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:30:58.197361 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:58.197898 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:58.199091 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:58.199589 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:58.352914 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:30:58.361613 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-6ff05320-d2fd-4ba8-964a-925435a7a793 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1576 microversion: 2.1 time: 0.179623 Jun 24 04:30:58.362346 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 630/1236] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:30:58 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:30:58.901252 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:30:58.901835 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:30:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:30:59.381433 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:30:59.382132 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:30:59.388688 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:59.389135 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:59.389892 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:30:59.390323 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:30:59.587976 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:30:59.595604 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3d6e217e-1343-43c2-ae0c-c02f350c5542 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1576 microversion: 2.1 time: 0.218933 Jun 24 04:30:59.596169 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 607/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:30:59 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:31:00.524931 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [req-ed712298-5c66-47fe-af61-cd06b2f15436 req-ae13508e-083b-4348-90e4-5db855053ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44ae3ea-a3c3-49cc-8914-814c72ad0554", "name": "network-vif-deleted", "tag": "83a55b30-ba60-47f7-8bb5-58f4abb3d9ac"}]} {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:31:00.536138 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ed712298-5c66-47fe-af61-cd06b2f15436 req-ae13508e-083b-4348-90e4-5db855053ddc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:00.538654 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [req-ed712298-5c66-47fe-af61-cd06b2f15436 req-ae13508e-083b-4348-90e4-5db855053ddc service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:00.550489 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.compute.server_external_events [req-ed712298-5c66-47fe-af61-cd06b2f15436 req-ae13508e-083b-4348-90e4-5db855053ddc service nova] Creating event network-vif-deleted:83a55b30-ba60-47f7-8bb5-58f4abb3d9ac for instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 on hv-cinder-84684 Jun 24 04:31:00.553949 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] [d887a965-cffd-4919-8c33-2ab1f9dcab95] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58130. Jun 24 04:31:00.555781 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [req-ed712298-5c66-47fe-af61-cd06b2f15436 req-ae13508e-083b-4348-90e4-5db855053ddc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Jun 24 04:31:00.556355 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 631/1238] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:31:00.613120 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:00.613750 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:00.621450 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:00.621943 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:00.624772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:00.624772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:00.691615 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:31:00.699427 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-540b597a-252b-4a90-89e5-e08a57269a55 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1224 microversion: 2.1 time: 0.090638 Jun 24 04:31:00.699989 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 608/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:00 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 04:31:01.719097 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:01.719697 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:01.726081 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:01.726631 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:01.727396 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:01.727856 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:01.759755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:01.760199 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:01.760643 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.objects.instance [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lazy-loading 'fault' on Instance uuid e44ae3ea-a3c3-49cc-8914-814c72ad0554 {{(pid=118331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 04:31:01.802475 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:31:01.809278 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fac48d93-6b7d-484a-9705-a6b634984602 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 200 len: 1183 microversion: 2.1 time: 0.094874 Jun 24 04:31:01.809871 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 632/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:01 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 1183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:31:02.827349 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:02.827965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: e44ae3ea-a3c3-49cc-8914-814c72ad0554] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:02.835005 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:02.835448 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:02.836220 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:02.836642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:02.849717 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] HTTP exception thrown: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Request method failure captured: Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 HTTP/1.1 Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTwnPmVQExO4WtTmUj2frpETf0pE6aV_c7MRXACPiQ5DbJh6ai_oeNS2hcOUl8M59_LK8UxOM68-vRKBQM6lgKWn817mfnGu29Filt_v_pHEsk38UO6gEP5qwR4dihMjtusb-fpGXX6c-sZ6T--0RQyf9qey7J4MaTrVZRQSdIVrj8U Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:31:02.851346 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9c12f0aa786483e8d1ce8ff9042164f"}]}] Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: d1cee676e3dc47e18e94de7e20b59455 Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. Jun 24 04:31:02.853212 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'e44ae3ea-a3c3-49cc-8914-814c72ad0554'} Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:31:02.854228 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. Jun 24 04:31:02.855986 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:02.857792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Returning 404 to user: Instance e44ae3ea-a3c3-49cc-8914-814c72ad0554 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:31:02.857792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-8ad0d8bd-906b-4b33-8946-bb6da351299c tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554" status: 404 len: 111 microversion: 2.1 time: 0.029347 Jun 24 04:31:02.857792 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 609/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:02 2022] GET /compute/v2.1/servers/e44ae3ea-a3c3-49cc-8914-814c72ad0554 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:31:05.357642 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:31:05.358249 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:31:06.187371 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:06.187903 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:06.189534 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-80722176-f0e7-49aa-93d3-d305665395e7 req-55a86854-e3b1-4791-a323-fb4abaab3779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4055b071-714c-42df-a252-68159d0f9020", "tag": "f85f217c-ad41-4b2e-a933-31e8c2468e20"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:31:06.194635 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:06.195087 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:06.195863 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:06.196300 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:06.198430 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-80722176-f0e7-49aa-93d3-d305665395e7 req-55a86854-e3b1-4791-a323-fb4abaab3779 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:06.199122 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-80722176-f0e7-49aa-93d3-d305665395e7 req-55a86854-e3b1-4791-a323-fb4abaab3779 service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:06.211153 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-80722176-f0e7-49aa-93d3-d305665395e7 req-55a86854-e3b1-4791-a323-fb4abaab3779 service nova] Creating event network-changed:f85f217c-ad41-4b2e-a933-31e8c2468e20 for instance 4055b071-714c-42df-a252-68159d0f9020 on hv-cinder-84684 Jun 24 04:31:06.217054 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-80722176-f0e7-49aa-93d3-d305665395e7 req-55a86854-e3b1-4791-a323-fb4abaab3779 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031536 Jun 24 04:31:06.217729 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 610/1242] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:31:06.223419 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Going to try to terminate instance {{(pid=118331) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 04:31:06.499000 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-4dff025b-8d15-48a5-8df3-fe3574315f5a tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 204 len: 0 microversion: 2.1 time: 0.314612 Jun 24 04:31:06.499000 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 633/1243] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:31:06 2022] DELETE /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 04:31:06.507833 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:06.508823 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:06.515040 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:06.515483 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:06.516246 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:06.516832 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:06.648908 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.policy [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118330) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:31:06.656912 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-17061e8d-bc4a-4651-82a2-91206c0d9be1 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1576 microversion: 2.1 time: 0.153227 Jun 24 04:31:06.666412 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 611/1244] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:06 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:31:07.674283 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:07.675022 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:07.681659 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:07.682113 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:07.702282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:07.702282 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:07.815648 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:31:07.823698 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-e6320a30-cbe8-4017-932f-79fd2ad97d67 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1576 microversion: 2.1 time: 0.153624 Jun 24 04:31:07.824321 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 634/1245] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:07 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:31:08.745509 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [req-fc1eb9b4-3534-4189-b84b-5be2df95ca6f req-c222b5e2-ac19-4145-b5b6-a7331112fbaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4055b071-714c-42df-a252-68159d0f9020", "name": "network-vif-deleted", "tag": "f85f217c-ad41-4b2e-a933-31e8c2468e20"}]} {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 04:31:08.755325 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-fc1eb9b4-3534-4189-b84b-5be2df95ca6f req-c222b5e2-ac19-4145-b5b6-a7331112fbaa service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:08.755772 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [req-fc1eb9b4-3534-4189-b84b-5be2df95ca6f req-c222b5e2-ac19-4145-b5b6-a7331112fbaa service nova] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:08.766510 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.compute.server_external_events [req-fc1eb9b4-3534-4189-b84b-5be2df95ca6f req-c222b5e2-ac19-4145-b5b6-a7331112fbaa service nova] Creating event network-vif-deleted:f85f217c-ad41-4b2e-a933-31e8c2468e20 for instance 4055b071-714c-42df-a252-68159d0f9020 on hv-cinder-84684 Jun 24 04:31:08.771953 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [req-fc1eb9b4-3534-4189-b84b-5be2df95ca6f req-c222b5e2-ac19-4145-b5b6-a7331112fbaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Jun 24 04:31:08.772530 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 612/1246] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jun 24 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 04:31:08.841181 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:08.841734 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:08.848559 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:08.849009 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:08.849822 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:08.850483 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:08.915750 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.policy [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cee676e3dc47e18e94de7e20b59455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c12f0aa786483e8d1ce8ff9042164f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118331) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 04:31:08.923306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-fe1c2250-99da-46e4-bd4e-be9aeb56cab5 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 200 len: 1224 microversion: 2.1 time: 0.086089 Jun 24 04:31:08.923874 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 635/1247] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:08 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 04:31:09.942093 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:09.942809 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: 4055b071-714c-42df-a252-68159d0f9020] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:09.948960 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:09.949401 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:09.950156 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:09.950721 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:09.964582 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] HTTP exception thrown: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Request method failure captured: Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 HTTP/1.1 Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTwnPmVQExO4WtTmUj2frpETf0pE6aV_c7MRXACPiQ5DbJh6ai_oeNS2hcOUl8M59_LK8UxOM68-vRKBQM6lgKWn817mfnGu29Filt_v_pHEsk38UO6gEP5qwR4dihMjtusb-fpGXX6c-sZ6T--0RQyf9qey7J4MaTrVZRQSdIVrj8U Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:31:09.966223 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9c12f0aa786483e8d1ce8ff9042164f"}]}] Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: d1cee676e3dc47e18e94de7e20b59455 Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. Jun 24 04:31:09.968039 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': '4055b071-714c-42df-a252-68159d0f9020'} Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:31:09.972314 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. Jun 24 04:31:09.974438 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:09.985410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Returning 404 to user: Instance 4055b071-714c-42df-a252-68159d0f9020 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:31:09.985410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-105fe68b-b7c4-428c-9a11-3bfbc15cf8dd tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jun 24 04:31:09.985410 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 613/1248] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:09 2022] GET /compute/v2.1/servers/4055b071-714c-42df-a252-68159d0f9020 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:31:10.453745 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:10.454258 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.compute.api [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118331) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:10.461749 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:10.462189 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:10.462965 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:10.463395 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG oslo_concurrency.lockutils [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:10.477306 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.wsgi [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] HTTP exception thrown: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Request method failure captured: Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: request: DELETE /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 HTTP/1.1 Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept: application/json Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Accept-Encoding: identity Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Connection: close Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Length: 0 Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Content-Type: application/json Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Host: 10.222.0.16 Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Openstack-System-Scope: None Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: User-Agent: python-urllib3/1.26.9 Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Auth-Token: gAAAAABitTwnPmVQExO4WtTmUj2frpETf0pE6aV_c7MRXACPiQ5DbJh6ai_oeNS2hcOUl8M59_LK8UxOM68-vRKBQM6lgKWn817mfnGu29Filt_v_pHEsk38UO6gEP5qwR4dihMjtusb-fpGXX6c-sZ6T--0RQyf9qey7J4MaTrVZRQSdIVrj8U Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Id: None Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Domain-Name: None Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Identity-Status: Confirmed Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Is-Admin-Project: True Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Id: default Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Domain-Name: Default Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Project-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Role: reader,member Jun 24 04:31:10.478948 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Roles: reader,member Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9c12f0aa786483e8d1ce8ff9042164f"}]}] Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-Tenant-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Id: default Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Domain-Name: Default Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Id: d1cee676e3dc47e18e94de7e20b59455 Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: X-User-Name: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: method: > Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: exception: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.480679 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: action_args: {'id': 'fe0901d6-f9f8-423b-872f-c51e28ede6a9'} Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:31:10.481755 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.483405 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.485424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Returning 404 to user: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. {{(pid=118331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:31:10.485424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-bc1b2f33-df23-4b19-80d1-0e2c011dbac0 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 404 len: 111 microversion: 2.1 time: 0.030665 Jun 24 04:31:10.485424 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 636/1249] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jun 24 04:31:10 2022] DELETE /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:31:10.488965 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '>' {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:10.489592 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.compute.api [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] [instance: fe0901d6-f9f8-423b-872f-c51e28ede6a9] Fetching instance by UUID {{(pid=118330) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 04:31:10.495555 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:10.496001 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:10.496755 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 04:31:10.497183 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG oslo_concurrency.lockutils [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Lock "d23276fb-df4e-471b-bff8-7999f072e73f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 04:31:10.510620 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.wsgi [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] HTTP exception thrown: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Request method failure captured: Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: request: GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 HTTP/1.1 Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept: application/json Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Accept-Encoding: identity Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Connection: close Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Length: 0 Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Content-Type: application/json Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Host: 10.222.0.16 Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Openstack-System-Scope: None Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: User-Agent: python-urllib3/1.26.9 Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Auth-Token: gAAAAABitTwnPmVQExO4WtTmUj2frpETf0pE6aV_c7MRXACPiQ5DbJh6ai_oeNS2hcOUl8M59_LK8UxOM68-vRKBQM6lgKWn817mfnGu29Filt_v_pHEsk38UO6gEP5qwR4dihMjtusb-fpGXX6c-sZ6T--0RQyf9qey7J4MaTrVZRQSdIVrj8U Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Id: None Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Domain-Name: None Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Identity-Status: Confirmed Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Is-Admin-Project: True Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Id: default Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Domain-Name: Default Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Project-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Role: reader,member Jun 24 04:31:10.512141 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Roles: reader,member Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9c12f0aa786483e8d1ce8ff9042164f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9c12f0aa786483e8d1ce8ff9042164f"}]}] Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Id: f9c12f0aa786483e8d1ce8ff9042164f Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-Tenant-Name: tempest-TestVolumeBootPattern-1368551579 Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Id: default Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Domain-Name: Default Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Id: d1cee676e3dc47e18e94de7e20b59455 Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: X-User-Name: tempest-TestVolumeBootPattern-1368551579-project Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: method: > Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: exception: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.513874 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: action_args: {'id': 'fe0901d6-f9f8-423b-872f-c51e28ede6a9'} Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: {{(pid=118330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 04:31:10.515061 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. Jun 24 04:31:10.516658 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: ERROR nova.api.openstack.wsgi Jun 24 04:31:10.518126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: DEBUG nova.api.openstack.wsgi [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Returning 404 to user: Instance fe0901d6-f9f8-423b-872f-c51e28ede6a9 could not be found. {{(pid=118330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 04:31:10.518126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO nova.api.openstack.requestlog [None req-3fe0f196-c56e-496b-844d-4829e7294f14 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9" status: 404 len: 111 microversion: 2.1 time: 0.028606 Jun 24 04:31:10.518126 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: [pid: 118330|app: 0|req: 614/1250] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jun 24 04:31:10 2022] GET /compute/v2.1/servers/fe0901d6-f9f8-423b-872f-c51e28ede6a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 04:31:11.982567 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: DEBUG nova.api.openstack.wsgi [None req-d203b182-9338-421c-b954-a1f6f6f997f7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] Calling method '.version_select at 0x7fdfed28c4c0>' {{(pid=118331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 04:31:12.070839 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO nova.api.openstack.requestlog [None req-d203b182-9338-421c-b954-a1f6f6f997f7 tempest-TestVolumeBootPattern-1368551579 tempest-TestVolumeBootPattern-1368551579-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716432859" status: 202 len: 0 microversion: 2.1 time: 0.092088 Jun 24 04:31:12.071512 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: [pid: 118331|app: 0|req: 637/1251] 10.222.0.16 () {58 vars in 1259 bytes} [Fri Jun 24 04:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716432859 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 04:32:34.660185 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:32:34.660805 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:34:10.398813 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:34:10.399416 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:34:18.913516 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:34:18.914059 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:34:25.367180 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:34:25.367732 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:35:54.668421 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:35:54.669046 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:36:10.491774 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:36:10.492274 dv-cinder-846842-3-iscsi devstack@n-api.service[118331]: Fri Jun 24 04:36:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 04:36:16.871428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 04:36:16.871428 dv-cinder-846842-3-iscsi devstack@n-api.service[118330]: Fri Jun 24 04:36:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!